2024-02-28 07:22:59 | INFO | model_worker | args: Namespace(host='localhost', port=21002, worker_address='http://localhost:21002', controller_address='http://localhost:21001', model_path='MBZUAI/MobiLlama-05B-Chat', revision='main', device='cuda', gpus=None, num_gpus=1, max_gpu_memory=None, dtype=None, load_8bit=False, cpu_offloading=False, gptq_ckpt=None, gptq_wbits=16, gptq_groupsize=-1, gptq_act_order=False, awq_ckpt=None, awq_wbits=16, awq_groupsize=-1, enable_exllama=False, exllama_max_seq_len=4096, exllama_gpu_split=None, exllama_cache_8bit=False, enable_xft=False, xft_max_seq_len=4096, xft_dtype=None, model_names=None, conv_template=None, embed_in_truncate=False, limit_worker_concurrency=5, stream_interval=2, no_register=False, seed=None, debug=False, ssl=False)
2024-02-28 07:22:59 | INFO | model_worker | Loading the model ['MobiLlama-05B-Chat'] on worker 3b010432 ...
2024-02-28 07:23:02 | INFO | model_worker | Register to controller
2024-02-28 07:23:03 | ERROR | stderr | INFO:     Started server process [3070045]
2024-02-28 07:23:03 | ERROR | stderr | INFO:     Waiting for application startup.
2024-02-28 07:23:03 | ERROR | stderr | INFO:     Application startup complete.
2024-02-28 07:23:03 | ERROR | stderr | INFO:     Uvicorn running on http://localhost:21002 (Press CTRL+C to quit)
2024-02-28 07:23:36 | INFO | stdout | INFO:     127.0.0.1:37344 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:23:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: None. call_ct: 0. worker_id: 3b010432. 
2024-02-28 07:24:07 | INFO | stdout | INFO:     127.0.0.1:47072 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:24:07 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:24:07 | INFO | stdout | ### Human: Hi how are you?
2024-02-28 07:24:07 | INFO | stdout | ### Assistant:
2024-02-28 07:24:20 | INFO | stdout | INFO:     127.0.0.1:45900 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:24:20 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:24:20 | INFO | stdout | ### Human: In which city you are in?
2024-02-28 07:24:20 | INFO | stdout | ### Assistant:
2024-02-28 07:24:26 | INFO | stdout | INFO:     127.0.0.1:47074 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:24:26 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:24:26 | INFO | stdout | ### Human: What is your name?
2024-02-28 07:24:26 | INFO | stdout | ### Assistant:
2024-02-28 07:24:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 3. worker_id: 3b010432. 
2024-02-28 07:25:00 | INFO | stdout | INFO:     127.0.0.1:48684 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:25:00 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:25:00 | INFO | stdout | ### Human: Write a C code to find the 5 multiple of 7.
2024-02-28 07:25:00 | INFO | stdout | ### Assistant:
2024-02-28 07:25:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 4. worker_id: 3b010432. 
2024-02-28 07:25:29 | INFO | stdout | INFO:     127.0.0.1:34948 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:25:29 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:25:29 | INFO | stdout | ### Human: Write a C code to find the 5 multiple of 7.
2024-02-28 07:25:29 | INFO | stdout | ### Assistant:
2024-02-28 07:26:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:26:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:27:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:28:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:29:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:29:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:30:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:31:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:32:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:32:51 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:33:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 5. worker_id: 3b010432. 
2024-02-28 07:33:43 | INFO | stdout | INFO:     127.0.0.1:57144 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-02-28 07:34:10 | INFO | stdout | INFO:     127.0.0.1:38058 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:34:10 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:34:10 | INFO | stdout | ### Human: Hi how are you?
2024-02-28 07:34:10 | INFO | stdout | ### Assistant:
2024-02-28 07:34:22 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 6. worker_id: 3b010432. 
2024-02-28 07:34:37 | INFO | stdout | INFO:     127.0.0.1:34414 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:34:37 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:34:37 | INFO | stdout | ### Human: In which city you are in?
2024-02-28 07:34:37 | INFO | stdout | ### Assistant:
2024-02-28 07:34:52 | INFO | stdout | INFO:     127.0.0.1:54706 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:34:52 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:34:52 | INFO | stdout | ### Human: What is your name?
2024-02-28 07:34:52 | INFO | stdout | ### Assistant:
2024-02-28 07:35:07 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 8. worker_id: 3b010432. 
2024-02-28 07:35:52 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 8. worker_id: 3b010432. 
2024-02-28 07:36:38 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 8. worker_id: 3b010432. 
2024-02-28 07:36:52 | INFO | stdout | INFO:     127.0.0.1:53958 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:36:52 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:36:52 | INFO | stdout | ### Human: Write a C code to find the 5 multiple of 7.
2024-02-28 07:36:52 | INFO | stdout | ### Assistant:
2024-02-28 07:37:23 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 9. worker_id: 3b010432. 
2024-02-28 07:37:24 | INFO | stdout | INFO:     127.0.0.1:54056 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:37:24 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:37:24 | INFO | stdout | ### Human: Write a python code to find the factorial of a number
2024-02-28 07:37:24 | INFO | stdout | ### Assistant:
2024-02-28 07:38:08 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 10. worker_id: 3b010432. 
2024-02-28 07:38:53 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 10. worker_id: 3b010432. 
2024-02-28 07:39:39 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 10. worker_id: 3b010432. 
2024-02-28 07:40:24 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 10. worker_id: 3b010432. 
2024-02-28 07:41:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 10. worker_id: 3b010432. 
2024-02-28 07:41:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 10. worker_id: 3b010432. 
2024-02-28 07:42:00 | INFO | stdout | INFO:     127.0.0.1:38232 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:42:00 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:42:00 | INFO | stdout | ### Human: How can I make new friends?
2024-02-28 07:42:00 | INFO | stdout | ### Assistant:
2024-02-28 07:42:18 | INFO | stdout | INFO:     127.0.0.1:48050 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:42:19 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:42:19 | INFO | stdout | ### Human: Where can I go for party in Abu Dhabi?
2024-02-28 07:42:19 | INFO | stdout | ### Assistant:
2024-02-28 07:42:29 | INFO | stdout | INFO:     127.0.0.1:57756 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-02-28 07:42:29 | INFO | stdout | A chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.
2024-02-28 07:42:29 | INFO | stdout | ### Human: Where can I go for party in Abu Dhabi?
2024-02-28 07:42:29 | INFO | stdout | ### Assistant:
2024-02-28 07:42:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:43:25 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:44:10 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:44:55 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:45:40 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:46:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:47:11 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:47:56 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:48:41 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:49:26 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:50:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:50:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:51:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:52:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:53:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:53:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:54:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:55:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:56:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:56:57 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:57:42 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:58:27 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:59:12 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 07:59:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:00:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:01:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:02:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:02:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:03:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:04:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:05:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:05:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:06:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:07:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:08:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:08:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:09:43 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:10:28 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:11:13 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:11:58 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:12:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:13:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:14:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:14:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:15:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:16:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:17:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:17:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:18:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:19:29 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:20:14 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:20:59 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:21:44 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:22:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:23:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:24:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:24:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:25:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:26:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:27:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:27:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:28:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:29:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:30:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:30:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:31:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:32:15 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:33:00 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:33:45 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:34:30 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:35:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:36:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:36:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:37:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:38:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:39:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:39:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:40:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:41:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:42:01 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:42:46 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:43:31 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:44:16 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:45:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:45:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:46:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:47:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:48:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:48:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:49:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:50:17 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:51:02 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:51:47 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:52:32 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:53:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:54:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:54:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:55:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:56:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:57:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:57:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:58:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 08:59:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:00:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:00:48 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:01:33 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:02:18 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:03:03 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:03:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:04:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:05:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:06:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:06:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:07:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:08:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:09:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:09:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:10:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:11:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:12:04 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:12:49 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:13:34 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:14:19 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:15:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:15:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:16:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:17:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:18:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:18:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:19:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:20:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:21:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:21:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:22:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:23:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:24:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:24:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:25:35 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:26:20 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:27:05 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:27:50 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:28:36 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:29:21 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432. 
2024-02-28 09:30:06 | INFO | model_worker | Send heart beat. Models: ['MobiLlama-05B-Chat']. Semaphore: Semaphore(value=5, locked=False). call_ct: 13. worker_id: 3b010432.