add intel CPU to leaderboard

#32
by baptistecolle HF staff - opened
Hugging Face Optimum org
edited Sep 5

This PR add intel CPU to the leaderboard. We benchmark it with a aws-c7i-8xlarge-plus from AWS.

Additionally, the code has been refactored to allow the leaderboard to support a wider range of configurations. Previously, CUDA-specific settings were hardcoded, which limited flexibility. This refactoring makes the leaderboard more adaptable to different hardware

There is now an additional tabs for the intel results!
Screenshot 2024-09-05 at 14.27.30.png

Hugging Face Optimum org

There was some issues with optimum-benchmark docker images so the benchmarks could not be runned
Now it is fixed (https://github.com/huggingface/optimum-benchmark/pull/263), So i was able to get the benchmarking results.

There is an issue with the memory requirements not be collected properly during benchmarking. Thus the current results for CPU do not include memory requirement for each model. This will be fixed later but as it requires quite some investigation and debugging

baptistecolle changed pull request status to open
Hugging Face Optimum org

Looks good!

baptistecolle changed pull request status to merged

Sign up or log in to comment