Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
38 commits
Select commit Hold shift + click to select a range
2268f6e
[Fix] Handling Empty Usage Tag In CLI's PICS Parser (#43)
antonio-amjr Nov 25, 2025
11f20f8
Fix _send_prompt_response calls and added timeout for large upload (#44)
rquidute Nov 25, 2025
f7eeede
Show friendly message to unsupported TWO WAY TALK test execution usin…
rquidute Dec 5, 2025
edb58bd
Fixing the CLI Run Test Logic to handle project config and user confi…
antonio-amjr Dec 10, 2025
bd59e8f
Removed Error column from test execution list (#49)
rquidute Dec 15, 2025
b430a12
[Feature] Adding the Node ID to CLI Output (#48)
antonio-amjr Dec 16, 2025
be01c07
Fix cli unit tests not working (#50)
rquidute Dec 16, 2025
0f0ed94
[FIX] CLI PICS Parser And Prompt (#51)
antonio-amjr Dec 19, 2025
b8be4d6
Fix test_run_execution command (#52)
rquidute Dec 29, 2025
5b769dd
[Feature] Printing Manual Pairing Code (#53)
antonio-amjr Dec 30, 2025
ef50862
Adding the test parameters to the models to be used in the CLI's proj…
antonio-amjr Dec 31, 2025
5415ccb
Enhanced the th-cli available-tests command with new formatting optio…
rquidute Dec 31, 2025
aad933b
Increase websocket message size (#56)
rquidute Jan 7, 2026
d8c82c6
Improve FFmpeg Error Handling in Video Stream Tests (#57)
rquidute Jan 9, 2026
d9a5575
[Feature] Swap CLI Properties Config With JSON (#58)
antonio-amjr Jan 12, 2026
ec1bd24
Implement CLI Support for Push AV Tests (#59)
rquidute Jan 15, 2026
28648fd
[Feature] Double-Dash Extra Arguments (#60)
antonio-amjr Jan 20, 2026
718c48b
Fixing CLI run_tests command conditional for extra arguments
antonio-amjr Jan 26, 2026
75799ca
Fixing ChipServer info display when using no project ID or config opt…
antonio-amjr Jan 29, 2026
47bbd7f
Fix WebSocket close handshake error for long-running test executions …
rquidute Feb 10, 2026
d743f12
[FIX] Updating CLI API Client Generator (#62)
antonio-amjr Feb 10, 2026
1473173
Added NFC_WIFI and THREAD_MESHCOP
rquidute Feb 20, 2026
4d0560d
[Fix] CLI Project Create and Default Config (#67)
antonio-amjr Feb 23, 2026
cb9088a
Update regex pattern for test ID validation (#66)
aligruenhaupt Feb 24, 2026
fcfbb85
[Feature] Replace OpenAPI Generator with Datamodel-Code-Generator (#65)
antonio-amjr Feb 25, 2026
7993438
[Feature] Refactoring CLI Project Command (#68)
antonio-amjr Feb 26, 2026
9055fb8
Fix test case comparison logic (#69)
rquidute Mar 5, 2026
cc20100
Add missing image_handler.py and image_verification.html for snapshot…
rquidute Mar 10, 2026
8a7ba6d
Fix regex pattern to support additional valid test ID formats (#73)
rquidute Mar 10, 2026
edb6972
Feature/909 Improve CLI unit tests code coverage for camera files (#72)
rquidute Mar 10, 2026
9341cb3
[FIX] Run_Tests Command Configuration Logic (#74)
antonio-amjr Mar 10, 2026
16741f2
CLI to support two way talk tests (#75)
rquidute Mar 13, 2026
1880f81
[Feature] Add PICS Parameter To CLI Projects (#78)
antonio-amjr Mar 25, 2026
943c063
[Fix] Project Create Command With No PICS (#79)
antonio-amjr Apr 2, 2026
836a085
[FIX] Updating CLI To Handle Temporary PICS (#80)
antonio-amjr Apr 10, 2026
6e60ffd
[FEATURE] Update CLI with grouped logs download feature (#82)
greens May 15, 2026
b4266de
Adding config output for CLI project command
antonio-amjr May 18, 2026
7b8f3dd
Improving __print_config() method and adding short flags
antonio-amjr May 19, 2026
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
72 changes: 69 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
<!--
*
* Copyright (c) 2023 Project CHIP Authors
* Copyright (c) 2026 Project CHIP Authors
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
Expand Down Expand Up @@ -59,17 +59,83 @@ Run `th-cli available-tests` to get a list of tests available in Test Harness, p

### run-tests

Run `th-cli run-tests --tests-list <tests> [--title, -n <title>] [--config, -c <config>] [--pics-config-folder, -p <pics-config-folder>] [--project-id <ID>] [--no-color]` to start a new test execution.
Run `th-cli run-tests --tests-list <tests> [--title, -n <title>] [--config, -c <config>] [--pics-config-folder, -p <pics-config-folder>] [--project-id <ID>] [--no-color] [-- <extra-sdk-args>]` to start a new test execution.

Required:
- `--tests-list`: Comma-separated list of test case identifiers (e.g. --tests-list TC-ACE-1.1,TC_ACE_1_3)

Optional:
- `--title`: Custom title for the test run. If not provided, the current timestamp will be used as the default.
- `--config`: Path to the property config file. If not specified, default_config.properties will be used.
- `--config`: Path to the JSON config file. **Accepts two formats:**
- **Config-only**: `{"network": {...}, "dut_config": {...}}`
- **Full project format**: `{"name": "...", "config": {...}}` (automatically extracts config)

This allows the same JSON file to work with `project create`, `project update`, and `run-tests` commands. If not provided, the project's default configuration will be used.
- `--pics-config-folder`: Path to the folder that contains PICS files. If not specified, no PICS file will be used.
- `--project-id`: Project ID that this test run belongs to. If not provided, uses the default 'CLI Execution Project' in TH.
- `--no-color`: Disable all colors from the CLI's output text of this test run execution
- `-- <extra-sdk-args>`: Pass additional arguments directly to the SDK container Python tests. Use the double dash (`--`) separator followed by any SDK test arguments. These arguments will be added to every Python test execution in the run.

**Example config files:**

Config-only format:
```json
{
"network": {
"wifi": {"ssid": "MyNetwork", "password": "MyPassword"}
},
"dut_config": {
"pairing_mode": "ble-wifi",
"setup_code": "20202021"
}
}
```

Full project format (works with all commands):
```json
{
"name": "My Project",
"config": {
"network": {
"wifi": {"ssid": "MyNetwork", "password": "MyPassword"}
},
"dut_config": {
"pairing_mode": "ble-wifi",
"setup_code": "20202021"
}
}
}
```

**Passing Extra Arguments to SDK Tests:**

You can pass additional arguments directly to the SDK container test execution using the `--` separator. Everything after `--` will be passed as-is to the Python test runner.

Examples:
```bash
# Enable trace logging for all tests in the run
th-cli run-tests -t TC-ACE-1.1 -- --trace-to json:log

# Pass boolean argument
th-cli run-tests -t TC-ACE-1.1,TC-ACE-1.2 -- --bool-arg flag:true

# Pass multiple extra arguments
th-cli run-tests -t TC-ACE-1.1 -- --timeout 60 --int-arg some-arg:1 --bool-arg flag:true

# Combine with other CLI options
th-cli run-tests -t TC-ACE-1.1 --config my-config.json --no-color -- --trace-to json:log
```

Common SDK test arguments you might want to use for example:
- `--endpoint <value>` - Choose the device endpoint
- `--trace-to json:log` - Enable detailed trace logging
- `--timeout <seconds>` - Override default test timeout
- `--int-arg <name>:<value>` - Pass integer argument to test
- `--bool-arg <name>:<true|false>` - Pass boolean argument to test
- `--string-arg <name>:<value>` - Pass string argument to test
- `--hex-arg <name>:<hex-value>` - Pass hex value argument to test

**Note:** These extra arguments are applied to ALL Test Cases in the test run. Invalid arguments could cause test failures, so ensure the arguments are valid for the SDK test framework.

### test-run-execution-history

Expand Down
17 changes: 0 additions & 17 deletions client_generator/.gitignore

This file was deleted.

25 changes: 0 additions & 25 deletions client_generator/Dockerfile

This file was deleted.

Empty file.
192 changes: 0 additions & 192 deletions client_generator/LICENSE.TXT

This file was deleted.

Empty file.
Loading