Name		Name	Last commit message	Last commit date
parent directory ..
README.md		README.md
backend.py		backend.py
benchmark_run.sh		benchmark_run.sh
dataset.py		dataset.py
install.sh		install.sh
main.py		main.py
mlperf.conf		mlperf.conf
start_server.sh		start_server.sh
user.conf		user.conf
warmup.py		warmup.py

README.md

Run MLPerf tests

NOTE: currently only tried with mixtral; and only tried with offline benchmark

How to run

1. Install

./install.sh

2. Start server

./start_server.sh

3. Warm up the server

python warmup.py

4. Run the benchmark, now it runs offline mode

./benchmark_run.sh