Testdriver templates allow you to easily run benchmarks using configurations tailored to your usecases.
Creating a Testdriver Template for AI inference tests
Testdriver templates can be created at the home Testdriver web interface.
- Benchmark template name. We recommend a descriptive name for easier selection.
- Procyon Suite version to use in the created template.
Please note this will not automatically change to the latest version of Procyon. If you wish to use the latest version, you must create a new template. - Advanced run options toggle. This toggles options to modify the benchmark runs with additional command-line or XML parameters.
- Toggle command line with settings.
This enables further benchmark configuration settings typically available via command-line. (e.g. for Procyon, those found in the Procyon command-line guide.) - Configuration XML - This is copied from the definition file found in the benchmark installation directory.
By editing the configuration XML, you can select which AI accelerator to run the test on, as well as the AI model precision you wish to use.
Please note that higher precisions may significantly increase the run time for some tests.
Procyon's default install directories can be found at the following locations:
Windows
C:\Program Files\UL\Procyon - Save Testdriver template.
Running a Testdriver Template
After you have created a Template, you can easily run it using the same interface.
- Select the Testdriver template from previously created templates.
- Load the selected Testdriver template.
- List of selected devices that will run the template.