Adding a new benchmark

Requirements for benchmark

  1. The Benchmark is publicly available from the Docker Hub

  2. It produces a JSON output file

  3. (optional but recommended) JSON schema for the output file is available

Adding a benchmark via the website

To submit a new benchmark, first navigate to the Benchmark Submission Page:

_images/select_benchmark.png

On the benchmark submission page:

_images/add_benchmark.png

  1. Enter the docker image name of your benchmark (for example: thechristophe/openbench-c-ray)

  2. Enter the tag of your docker image you used

  3. (optional) Add a description of your benchmark for other users.

  4. Add the JSON schema the results of this benchmark must conform to

  5. Submit your result

Adding a benchmark using the API

For a detailed example on how to use the API to submit a benchmark, please have a look at the Jupyter notebook.