Spaces:
Running
add intel CPU to leaderboard
This PR add intel CPU to the leaderboard. We benchmark it with a aws-c7i-8xlarge-plus from AWS.
Additionally, the code has been refactored to allow the leaderboard to support a wider range of configurations. Previously, CUDA-specific settings were hardcoded, which limited flexibility. This refactoring makes the leaderboard more adaptable to different hardware
There was some issues with optimum-benchmark docker images so the benchmarks could not be runned
Now it is fixed (https://github.com/huggingface/optimum-benchmark/pull/263), So i was able to get the benchmarking results.
There is an issue with the memory requirements not be collected properly during benchmarking. Thus the current results for CPU do not include memory requirement for each model. This will be fixed later but as it requires quite some investigation and debugging
Looks good!