File size: 503 Bytes
cc24a5b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
evaluate my_api model: 1、prepare the environment cd opencompass conda create --name opencompass python=3.10 pytorch torchvision pytorch-cuda -c nvidia -c pytorch -y conda activate opencompass pip install -e . 2、download the evaluation set # Download dataset to data/ folder wget https://github.com/open-compass/opencompass/releases/download/0.2.2.rc1/OpenCompassData-core-20240207.zip unzip OpenCompassData-core-20240207.zip 3、testing xxx dataset python run.py --models my_api --datasets xxx_gen |