model,hour,execution_time,characters_count,words_count Mistral-7B-Instruct-v0.2,0.0,,, Mistral-7B-Instruct-v0.2,1.0,1.9149879813194275,37.8,2.95 Mistral-7B-Instruct-v0.2,2.0,,, Mistral-7B-Instruct-v0.2,3.0,,, Mistral-7B-Instruct-v0.2,4.0,,, Mistral-7B-Instruct-v0.2,5.0,,, Mistral-7B-Instruct-v0.2,6.0,,, Mistral-7B-Instruct-v0.2,7.0,,, Mistral-7B-Instruct-v0.2,8.0,,, Mistral-7B-Instruct-v0.2,9.0,,, Mistral-7B-Instruct-v0.2,10.0,,, Mistral-7B-Instruct-v0.2,11.0,3.734026002883911,362.9,58.35 Mistral-7B-Instruct-v0.2,12.0,3.1783012986183166,210.325,30.975 Mistral-7B-Instruct-v0.2,13.0,,, Mistral-7B-Instruct-v0.2,14.0,3.2796461462974547,233.8,33.525 Mistral-7B-Instruct-v0.2,15.0,3.749682915210724,362.9,58.35 Mistral-7B-Instruct-v0.2,16.0,3.023258109887441,172.18333333333334,22.95 Mistral-7B-Instruct-v0.2,17.0,,, Mistral-7B-Instruct-v0.2,18.0,3.741873788833618,362.9,58.35 Mistral-7B-Instruct-v0.2,19.0,,, Mistral-7B-Instruct-v0.2,20.0,3.225523215532303,210.325,30.975 Mistral-7B-Instruct-v0.2,21.0,3.2891411036252975,219.7875,31.7625 Mistral-7B-Instruct-v0.2,22.0,,, Mistral-7B-Instruct-v0.2,23.0,,, Mixtral-8x7B-Instruct-v0.1,0.0,5.600324046611786,399.5,61.7 Mixtral-8x7B-Instruct-v0.1,1.0,3.643988568608354,389.36,55.27 Mixtral-8x7B-Instruct-v0.1,2.0,3.1196579193246774,275.875,42.4 Mixtral-8x7B-Instruct-v0.1,3.0,3.017132020765735,316.8,49.025 Mixtral-8x7B-Instruct-v0.1,4.0,3.0949330102829706,200.375,30.9 Mixtral-8x7B-Instruct-v0.1,5.0,2.8691824844905307,279.65,42.95 Mixtral-8x7B-Instruct-v0.1,6.0,2.9245848854382834,251.4,38.7 Mixtral-8x7B-Instruct-v0.1,7.0,3.039147071838379,244.925,37.8 Mixtral-8x7B-Instruct-v0.1,8.0,3.6833377838134767,236.73333333333332,36.68333333333333 Mixtral-8x7B-Instruct-v0.1,9.0,2.35319835799081,286.25,44.75 Mixtral-8x7B-Instruct-v0.1,10.0,4.525930786132813,311.3,48.55 Mixtral-8x7B-Instruct-v0.1,11.0,4.267878273700146,308.85,47.7 Mixtral-8x7B-Instruct-v0.1,12.0,5.2255242466926575,350.46,50.36 Mixtral-8x7B-Instruct-v0.1,13.0,4.550832962644273,371.5375,57.975 Mixtral-8x7B-Instruct-v0.1,14.0,6.3550496492812885,390.675,55.725 Mixtral-8x7B-Instruct-v0.1,15.0,5.536225740114848,298.05,46.2 Mixtral-8x7B-Instruct-v0.1,16.0,6.244929383286332,410.9916666666667,51.69166666666667 Mixtral-8x7B-Instruct-v0.1,17.0,4.749357461929321,255.2,39.15 Mixtral-8x7B-Instruct-v0.1,18.0,3.441127454080889,312.875,48.525 Mixtral-8x7B-Instruct-v0.1,19.0,3.921023598888464,279.5625,43.225 Mixtral-8x7B-Instruct-v0.1,20.0,3.5051895811937857,380.725,53.875 Mixtral-8x7B-Instruct-v0.1,21.0,4.853644103915603,408.34166666666664,49.56666666666667 Mixtral-8x7B-Instruct-v0.1,22.0,3.1714347918828327,284.9,43.825 Mixtral-8x7B-Instruct-v0.1,23.0,4.876900292932987,321.725,49.875 TinyLlama/TinyLlama-1.1B-Chat-v1.0,0.0,2.0674875736236573,372.05,62.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0,1.0,1.2007620811462403,48.35,5.8 TinyLlama/TinyLlama-1.1B-Chat-v1.0,2.0,,, TinyLlama/TinyLlama-1.1B-Chat-v1.0,3.0,2.0712238788604735,372.05,62.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0,4.0,1.9543781518936156,372.05,62.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0,5.0,,, TinyLlama/TinyLlama-1.1B-Chat-v1.0,6.0,2.110265576839447,372.05,62.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0,7.0,2.0211721837520598,372.25,62.425 TinyLlama/TinyLlama-1.1B-Chat-v1.0,8.0,1.99203217625618,372.05,62.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0,9.0,,, TinyLlama/TinyLlama-1.1B-Chat-v1.0,10.0,,, TinyLlama/TinyLlama-1.1B-Chat-v1.0,11.0,1.9041210174560548,372.05,62.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0,12.0,1.8389003086090088,314.46,52.08 TinyLlama/TinyLlama-1.1B-Chat-v1.0,13.0,1.9219599564870198,353.6666666666667,59.266666666666666 TinyLlama/TinyLlama-1.1B-Chat-v1.0,14.0,1.7107620418071747,227.325,36.3 TinyLlama/TinyLlama-1.1B-Chat-v1.0,15.0,1.8755218625068664,372.05,62.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0,16.0,1.538642168045044,169.46666666666667,26.083333333333332 TinyLlama/TinyLlama-1.1B-Chat-v1.0,17.0,1.9580047667026519,371.875,62.425 TinyLlama/TinyLlama-1.1B-Chat-v1.0,18.0,1.857077181339264,372.05,62.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0,19.0,1.938528937101364,371.625,62.3 TinyLlama/TinyLlama-1.1B-Chat-v1.0,20.0,1.628979456424713,227.325,36.3 TinyLlama/TinyLlama-1.1B-Chat-v1.0,21.0,1.7358034878969193,220.1125,35.2125 TinyLlama/TinyLlama-1.1B-Chat-v1.0,22.0,,, TinyLlama/TinyLlama-1.1B-Chat-v1.0,23.0,2.094106078147888,372.05,62.6 chat-bison,1.0,3.890243631601334,398.075,49.0 chat-bison (PaLM 2),0.0,2.501569759845734,381.95,60.9 chat-bison (PaLM 2),1.0,2.476984361807505,381.95,60.9 chat-bison (PaLM 2),2.0,2.438890391588211,381.95,60.9 chat-bison (PaLM 2),3.0,2.440149003267288,381.95,60.9 chat-bison (PaLM 2),4.0,2.4795879781246186,381.95,60.9 chat-bison (PaLM 2),5.0,2.461125838756561,381.8,61.1 chat-bison (PaLM 2),6.0,2.469940322637558,381.95,60.9 chat-bison (PaLM 2),7.0,2.4428869783878326,381.95,60.9 chat-bison (PaLM 2),8.0,2.4800265431404114,381.8833333333333,60.88333333333333 chat-bison (PaLM 2),9.0,2.465018570423126,381.95,60.9 chat-bison (PaLM 2),10.0,2.4786566257476808,381.75,60.85 chat-bison (PaLM 2),11.0,2.499571430683136,381.65,60.88333333333333 chat-bison (PaLM 2),12.0,2.571754927635193,352.17,50.81 chat-bison (PaLM 2),13.0,2.522790166735649,409.325,65.3875 chat-bison (PaLM 2),14.0,2.8620632350444795,373.375,52.9875 chat-bison (PaLM 2),15.0,2.650241893529892,377.8,60.425 chat-bison (PaLM 2),16.0,3.4333535691102344,381.84166666666664,47.225 chat-bison (PaLM 2),17.0,2.5084280292193095,381.95,60.9 chat-bison (PaLM 2),18.0,2.615047258138657,381.45,60.85 chat-bison (PaLM 2),19.0,2.821215844154358,382.225,61.025 chat-bison (PaLM 2),20.0,2.591941976547241,344.725,48.275 chat-bison (PaLM 2),21.0,2.7827586233615875,383.275,47.65833333333333 chat-bison (PaLM 2),22.0,2.813016355037689,381.95,60.9 chat-bison (PaLM 2),23.0,2.463971793651581,381.85,60.875 chat-bison-32k,1.0,4.128177767992019,389.925,48.025 chat-bison-32k (PaLM 2 32K),0.0,7.170754861831665,335.75,53.85 chat-bison-32k (PaLM 2 32K),1.0,9.889513119061787,335.75,53.85 chat-bison-32k (PaLM 2 32K),2.0,4.82983283996582,335.75,53.85 chat-bison-32k (PaLM 2 32K),3.0,6.070689761638642,335.75,53.85 chat-bison-32k (PaLM 2 32K),4.0,8.697703075408935,335.75,53.85 chat-bison-32k (PaLM 2 32K),5.0,2.9196789026260377,335.75,53.85 chat-bison-32k (PaLM 2 32K),6.0,10.046520245075225,335.75,53.85 chat-bison-32k (PaLM 2 32K),7.0,8.814902746677399,335.75,53.85 chat-bison-32k (PaLM 2 32K),8.0,8.755691254138947,335.75,53.85 chat-bison-32k (PaLM 2 32K),9.0,2.943085324764252,335.75,53.85 chat-bison-32k (PaLM 2 32K),10.0,13.628323638439179,335.75,53.85 chat-bison-32k (PaLM 2 32K),11.0,7.315447652339936,335.75,53.85 chat-bison-32k (PaLM 2 32K),12.0,6.040619640350342,323.17,45.15 chat-bison-32k (PaLM 2 32K),13.0,3.8712039202451707,359.3,57.725 chat-bison-32k (PaLM 2 32K),14.0,4.875012156367302,339.6875,46.1375 chat-bison-32k (PaLM 2 32K),15.0,2.951279658079147,335.75,53.85 chat-bison-32k (PaLM 2 32K),16.0,4.577468846241633,359.4166666666667,43.775 chat-bison-32k (PaLM 2 32K),17.0,5.394908706347148,335.75,53.85 chat-bison-32k (PaLM 2 32K),18.0,7.554238790273667,335.75,53.85 chat-bison-32k (PaLM 2 32K),19.0,10.186308375000953,335.75,53.85 chat-bison-32k (PaLM 2 32K),20.0,5.36962095797062,320.025,42.975 chat-bison-32k (PaLM 2 32K),21.0,5.4035370687643685,359.4166666666667,43.775 chat-bison-32k (PaLM 2 32K),22.0,12.272967928647995,335.75,53.85 chat-bison-32k (PaLM 2 32K),23.0,10.500626176595688,335.75,53.85 gemini-pro,0.0,2.8754740890703703,364.45,57.0 gemini-pro,1.0,3.731358753455864,375.3,55.09 gemini-pro,2.0,2.664601039886475,358.825,57.425 gemini-pro,3.0,2.8943973687978892,387.0,61.725 gemini-pro,4.0,2.8736069202423096,371.375,60.025 gemini-pro,5.0,2.656540846824646,357.25,56.7 gemini-pro,6.0,2.8120841443538667,390.4,62.45 gemini-pro,7.0,2.70631699073009,378.2,60.35 gemini-pro,8.0,2.7259290743682345,377.1166666666667,60.38333333333333 gemini-pro,9.0,2.6013306021690368,396.15,63.35 gemini-pro,10.0,2.4627303073280737,381.7,59.75 gemini-pro,11.0,2.4739445872226002,360.6,57.95 gemini-pro,12.0,2.7814492097834953,348.55,49.4 gemini-pro,13.0,2.559203814856614,392.975,63.875 gemini-pro,14.0,3.1300881316787317,343.3625,47.4625 gemini-pro,15.0,2.4760417878627776,361.275,58.075 gemini-pro,16.0,3.3130789541565213,353.7,41.59166666666667 gemini-pro,17.0,2.492802628016068,388.51666666666665,61.8 gemini-pro,18.0,2.7202366315401516,362.925,57.825 gemini-pro,19.0,2.6147810145269466,392.6875,62.0125 gemini-pro,20.0,3.2052203896757843,341.85,46.6875 gemini-pro,21.0,3.6886135495227315,358.10833333333335,44.858333333333334 gemini-pro,22.0,2.6609258592128753,376.325,60.05 gemini-pro,23.0,2.590940225124359,367.15,58.6 gpt-3.5-turbo,0.0,3.5683146858215333,404.84,43.88 gpt-3.5-turbo,1.0,4.272891883608661,444.9625,48.91875 gpt-3.5-turbo,2.0,2.6514626717567444,390.22,54.64 gpt-3.5-turbo,3.0,8.802967548370361,438.15833333333336,48.75 gpt-3.5-turbo,4.0,3.9857387453317643,409.6,38.875 gpt-3.5-turbo,5.0,3.3526177048683166,391.56666666666666,45.35 gpt-3.5-turbo,6.0,3.9461031516393024,413.46666666666664,46.666666666666664 gpt-3.5-turbo,7.0,3.563987676302592,396.7,48.483333333333334 gpt-3.5-turbo,8.0,3.8539037982622784,401.06666666666666,46.88333333333333 gpt-3.5-turbo,9.0,3.774983811378479,373.15,41.81666666666667 gpt-3.5-turbo,10.0,,, gpt-3.5-turbo,11.0,2.8019149283568066,398.40833333333336,55.5 gpt-3.5-turbo,12.0,4.098882734775543,346.4125,34.7375 gpt-3.5-turbo,13.0,3.8091073359761918,414.22857142857146,50.82142857142857 gpt-3.5-turbo,14.0,3.901234769821167,389.9,47.55833333333333 gpt-3.5-turbo,15.0,4.8184381556510925,411.03,42.87 gpt-3.5-turbo,16.0,3.899510098587383,376.54545454545456,43.67727272727273 gpt-3.5-turbo,17.0,5.015711693763733,425.6,42.83 gpt-3.5-turbo,18.0,3.721581067641576,378.26666666666665,44.46666666666667 gpt-3.5-turbo,19.0,3.851715175310771,399.625,46.0 gpt-3.5-turbo,20.0,3.153710008992089,380.1611111111111,47.05555555555556 gpt-3.5-turbo,21.0,4.117136875174681,407.26153846153846,40.63076923076923 gpt-3.5-turbo,22.0,3.208261313041051,396.3,46.266666666666666 gpt-3.5-turbo,23.0,8.566175188620885,441.65833333333336,49.28333333333333 gpt-4,0.0,12.091028991371694,316.73,37.44 gpt-4,1.0,12.780311059551078,338.25416666666666,40.09166666666667 gpt-4,2.0,11.616398258209228,341.39,48.28 gpt-4,3.0,12.220598830779393,324.725,40.541666666666664 gpt-4,4.0,13.938926541805268,303.1625,31.9875 gpt-4,5.0,12.497149809201558,319.71666666666664,40.63333333333333 gpt-4,6.0,13.388921443621317,330.0833333333333,41.46666666666667 gpt-4,7.0,14.678142400582631,323.53333333333336,40.733333333333334 gpt-4,8.0,14.978816239039103,317.0,39.43333333333333 gpt-4,9.0,15.373240264256795,324.98333333333335,40.5 gpt-4,10.0,,, gpt-4,11.0,11.441057385516768,344.78333333333336,50.025 gpt-4,12.0,17.375231413543226,295.78125,31.23125 gpt-4,13.0,15.355684958185469,337.90714285714284,44.85 gpt-4,14.0,14.926335791746775,325.48333333333335,41.733333333333334 gpt-4,15.0,17.480767397880555,301.15,34.69 gpt-4,16.0,17.60613609231226,325.15,39.6 gpt-4,17.0,14.354735706791732,299.63,35.66 gpt-4,18.0,13.452181231975555,317.68333333333334,39.675 gpt-4,19.0,14.330684673786163,317.45,39.791666666666664 gpt-4,20.0,13.774037790298461,318.76666666666665,40.80555555555556 gpt-4,21.0,15.565142148249858,308.5769230769231,33.707692307692305 gpt-4,22.0,15.137496527036031,323.8666666666667,41.00833333333333 gpt-4,23.0,10.696240643493267,317.28333333333336,40.175 gpt-4-turbo,0.0,11.938190605640411,384.78,44.55 gpt-4-turbo,1.0,14.554479810595513,382.94166666666666,48.0625 gpt-4-turbo,2.0,13.72197850227356,380.31,49.62 gpt-4-turbo,3.0,11.976015224059422,370.85833333333335,49.108333333333334 gpt-4-turbo,4.0,17.072669982910156,366.9875,44.7875 gpt-4-turbo,5.0,15.055192097028096,296.6666666666667,43.03333333333333 gpt-4-turbo,6.0,15.722527865568797,378.6166666666667,51.416666666666664 gpt-4-turbo,7.0,7.6716701745986935,302.23333333333335,40.96666666666667 gpt-4-turbo,8.0,11.272664443651836,392.1166666666667,49.266666666666666 gpt-4-turbo,9.0,20.45977386633555,332.1166666666667,43.5 gpt-4-turbo,10.0,,, gpt-4-turbo,11.0,10.300394964218139,406.775,60.791666666666664 gpt-4-turbo,12.0,16.01451396048069,374.3375,45.11875 gpt-4-turbo,13.0,13.703989851474763,327.0571428571429,46.714285714285715 gpt-4-turbo,14.0,11.651468181610108,347.85833333333335,46.458333333333336 gpt-4-turbo,15.0,37.896924748420716,367.4,49.16 gpt-4-turbo,16.0,18.2455517671325,395.83181818181816,48.56818181818182 gpt-4-turbo,17.0,15.710689465999604,364.73,42.88 gpt-4-turbo,18.0,16.597523101170857,379.60833333333335,47.983333333333334 gpt-4-turbo,19.0,19.196569097042083,355.68333333333334,46.958333333333336 gpt-4-turbo,20.0,14.754687264230515,401.8777777777778,49.75555555555555 gpt-4-turbo,21.0,14.39423566047962,439.87692307692305,42.72692307692308 gpt-4-turbo,22.0,17.963759408394495,437.6,50.358333333333334 gpt-4-turbo,23.0,11.649714199701945,332.7083333333333,43.733333333333334 llama-2-70b-chat,0.0,2.7049551407496133,312.85,48.55 llama-2-70b-chat,1.0,3.5678966999053956,355.78,52.5 llama-2-70b-chat,2.0,2.7264933708386545,341.675,52.75 llama-2-70b-chat,3.0,3.13531751036644,355.5,54.75 llama-2-70b-chat,4.0,2.6207807064056396,262.85,40.7 llama-2-70b-chat,5.0,2.4901255933861983,331.85,51.2 llama-2-70b-chat,6.0,3.237797245834813,298.0,46.025 llama-2-70b-chat,7.0,2.8074560369764057,309.8,47.225 llama-2-70b-chat,8.0,2.643855281498121,270.68333333333334,41.93333333333333 llama-2-70b-chat,9.0,2.270249330997467,355.5,54.75 llama-2-70b-chat,10.0,2.6760833263397217,165.55,25.2 llama-2-70b-chat,11.0,3.1485369634628295,298.56666666666666,45.766666666666666 llama-2-70b-chat,12.0,4.026921252409617,294.06,42.54 llama-2-70b-chat,13.0,4.110724348770945,428.7375,65.5375 llama-2-70b-chat,14.0,4.592028452555339,423.8875,60.8125 llama-2-70b-chat,15.0,2.76978215304288,285.925,44.15 llama-2-70b-chat,16.0,4.2957686424255375,572.3083333333333,74.625 llama-2-70b-chat,17.0,2.720098500781589,254.86666666666667,39.28333333333333 llama-2-70b-chat,18.0,2.9921934604644775,326.375,50.025 llama-2-70b-chat,19.0,2.7523183100151294,283.95,43.8375 llama-2-70b-chat,20.0,3.1451149598146095,345.975,49.65 llama-2-70b-chat,21.0,4.558388976727501,556.1583333333333,71.875 llama-2-70b-chat,22.0,3.0530899854806752,348.0,53.65 llama-2-70b-chat,23.0,2.941225928068161,355.5,54.75 zephyr-7b-beta,0.0,,, zephyr-7b-beta,1.0,1.9264068841934203,29.75,3.3 zephyr-7b-beta,2.0,,, zephyr-7b-beta,3.0,,, zephyr-7b-beta,4.0,,, zephyr-7b-beta,5.0,,, zephyr-7b-beta,6.0,,, zephyr-7b-beta,7.0,,, zephyr-7b-beta,8.0,,, zephyr-7b-beta,9.0,,, zephyr-7b-beta,10.0,,, zephyr-7b-beta,11.0,4.056525647640228,386.3,63.35 zephyr-7b-beta,12.0,3.3402509868144987,216.9,33.575 zephyr-7b-beta,13.0,,, zephyr-7b-beta,14.0,4.056431210041046,399.0,64.9 zephyr-7b-beta,15.0,4.06974081993103,386.3,63.35 zephyr-7b-beta,16.0,3.304698485362379,214.1625,32.7875 zephyr-7b-beta,17.0,,, zephyr-7b-beta,18.0,4.079625189304352,386.3,63.35 zephyr-7b-beta,19.0,,, zephyr-7b-beta,20.0,3.3111458659172057,216.9,33.575 zephyr-7b-beta,21.0,3.339973047375679,219.1875,33.6875 zephyr-7b-beta,22.0,,, zephyr-7b-beta,23.0,,,