Spaces:
Running
Running
| model,throughput,response_length,latency,energy | |
| camel-ai/CAMEL-13B-Combined-Data,21.698576445650616,246.24983210208194,11.359782962929792,2355.2015053727355 | |
| databricks/dolly-v2-12b,15.057831510732873,159.93451981195435,10.197591386884174,1619.948066823369 | |
| nomic-ai/gpt4all-13b-snoozy,21.81850230944136,220.82639355271994,10.106196799825966,2202.807249832109 | |
| project-baize/baize-v2-7B,32.278702324630125,300.21826729348555,9.151365330046675,1557.4543243787796 | |
| FreedomIntelligence/phoenix-inst-chat-7b,43.15794896524618,220.48556077904635,4.912834925525496,1134.9532484889164 | |
| Neutralzz/BiLLa-7B-SFT,31.576098085051683,146.43485560779047,4.467502261238455,821.7476809939546 | |
| OpenAssistant/oasst-sft-1-pythia-12b,15.249688094942522,252.08865010073876,16.127927775413387,2645.1371722632653 | |
| h2oai/h2ogpt-gm-oasst1-en-2048-open-llama-7b-preview-300bt-v2,31.9963132875822,228.91537944929482,7.081518725379781,1231.1418035594343 | |
| lmsys/fastchat-t5-3b-v1.0,30.11501180390337,359.11014103425117,18.113400371066604,872.8616652115497 | |
| BAIR/koala-13b,21.686819170677825,255.0466756212223,11.667351228473493,2196.7527931497716 | |
| StabilityAI/stablelm-tuned-alpha-7b,28.54267912639095,233.76057756883816,7.929687720685966,1381.3434637340479 | |
| lmsys/vicuna-13B,21.92047685400391,264.0950302216253,12.061023608554358,2516.2876131632 | |
| openaccess-ai-collective/manticore-13b-chat-pyg,21.703210621473303,274.1773002014775,12.581106571755186,2362.644396574878 | |
| togethercomputer/RedPajama-INCITE-7B-Chat,21.543639351812168,281.8143049026192,12.532223938875198,1700.600847212891 | |
| lmsys/vicuna-7B,31.797633189426183,268.90094022834114,8.36020701868699,1386.7618619879124 | |
| metaai/llama-13B,18.476088005501783,117.27736736064473,5.550619761657461,1274.2525688381443 | |
| metaai/llama-7B,23.642990385313613,110.3025520483546,3.7306664026356073,636.4017854264604 | |
| tatsu-lab/alpaca-7B,31.257537640928863,127.87004701141706,3.9853428024686144,671.8288287441229 | |
| BAIR/koala-7b,31.414143726094665,253.60376091336468,7.832867446137829,1181.3637347212878 | |
| BlinkDL/RWKV-4-Raven-7B-v12-Eng98%-Other2%-20230521-ctx8192.pth,39.9399840394634,246.79650772330425,5.83791405340994,1302.0306672263273 | |