Here find the list of artifacts that must be generated by the different benchmark types.

Benchmark Type 1

When the variable $BENCHMARK_TYPE is set to TYPE1 the following artifacts must be provided:

• Benchmark report : report.json
• Log files : user.log & error.log

Benchmark Type 2

When the variable $BENCHMARK_TYPE is set to TYPE2 the following artifacts must be provided:

• Benchmark report : report.json
• Log files : user.log & error.log
• Model output : raw_outpout.bin

Benchmark Type 3

When the variable $BENCHMARK_TYPE is set to TYPE3 the following artifacts must be provided:

• Benchmark report : report.json (odt version)
• Log files : user.log & error.log
• New Model : trained_model.extension

Report

The benchmark report is a json file that contains all the performance indicators and information about the benchmark. It must follow the structure defined in the benchmark report keys. The report must be saved in the AI_Manager/out folder of the target repository.

Log Files

Binary output