2024-09-30 20:53:03 | INFO | model_worker | args: Namespace(host='0.0.0.0', port=40000, worker_address='http://localhost:40000', controller_address='http://localhost:20001', model_path='/home/jack/Projects/yixin-llm/merge_med_llava_3', model_base=None, model_name=None, device='cuda', multi_modal=False, limit_model_concurrency=5, stream_interval=1, no_register=False, load_8bit=False, load_4bit=False)
2024-09-30 20:53:03 | INFO | model_worker | Loading the model merge_med_llava_3 on worker 187b68 ...
2024-09-30 20:53:03 | WARNING | transformers.models.llama.tokenization_llama | You are using the legacy behaviour of the <class 'transformers.models.llama.tokenization_llama.LlamaTokenizer'>. This means that tokens that come after special tokens will not be properly handled. We recommend you to read the related pull request available at https://github.com/huggingface/transformers/pull/24565
2024-09-30 20:53:03 | ERROR | stderr | /home/jack/anaconda3/envs/llavaplus/lib/python3.10/site-packages/huggingface_hub/file_download.py:1132: FutureWarning: `resume_download` is deprecated and will be removed in version 1.0.0. Downloads always resume when possible. If you want to force a new download, use `force_download=True`.
2024-09-30 20:53:03 | ERROR | stderr |   warnings.warn(
2024-09-30 20:53:03 | ERROR | stderr | 
Loading checkpoint shards:   0%|                                                                           | 0/2 [00:00<?, ?it/s]
2024-09-30 20:53:10 | ERROR | stderr | 
Loading checkpoint shards:  50%|█████████████████████████████████▌                                 | 1/2 [00:06<00:06,  6.53s/it]
2024-09-30 20:53:12 | ERROR | stderr | 
Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████| 2/2 [00:08<00:00,  3.93s/it]
2024-09-30 20:53:12 | ERROR | stderr | 
Loading checkpoint shards: 100%|███████████████████████████████████████████████████████████████████| 2/2 [00:08<00:00,  4.32s/it]
2024-09-30 20:53:12 | ERROR | stderr | 
2024-09-30 20:53:14 | INFO | model_worker | Register to controller
2024-09-30 20:53:14 | ERROR | stderr | INFO:     Started server process [1243118]
2024-09-30 20:53:14 | ERROR | stderr | INFO:     Waiting for application startup.
2024-09-30 20:53:14 | ERROR | stderr | INFO:     Application startup complete.
2024-09-30 20:53:14 | ERROR | stderr | INFO:     Uvicorn running on http://0.0.0.0:40000 (Press CTRL+C to quit)
2024-09-30 20:53:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:53:35 | INFO | stdout | INFO:     127.0.0.1:45472 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 20:53:44 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:53:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:54:01 | INFO | stdout | INFO:     127.0.0.1:36220 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 20:54:14 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:54:29 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:54:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:55:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:55:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:55:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:55:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:56:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:56:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:56:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:56:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:57:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:57:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:57:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:57:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:58:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:58:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:58:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:58:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:59:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:59:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:59:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 20:59:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:00:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:00:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:00:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:00:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:01:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:01:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:01:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:01:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:02:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:02:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:02:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:02:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:03:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:03:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:03:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:03:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:04:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:04:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:04:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:04:45 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:05:00 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:05:15 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:05:30 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:05:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:06:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:06:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:06:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:06:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:07:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:07:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:07:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:07:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:08:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:08:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:08:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:08:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:09:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:09:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:09:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:09:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:10:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:10:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:10:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:10:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:11:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:11:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:11:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:11:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:12:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:12:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:12:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:12:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:13:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:13:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:13:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:13:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:14:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:14:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:14:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:14:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:15:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:15:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:15:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:15:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:16:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:16:16 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:16:31 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:16:46 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:17:01 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:17:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:17:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:17:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:18:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:18:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:18:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:18:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:19:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:19:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:19:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:19:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:20:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:20:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:20:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:20:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:21:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:21:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:21:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:21:41 | INFO | stdout | INFO:     127.0.0.1:48496 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 21:21:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:21:54 | INFO | stdout | INFO:     127.0.0.1:58382 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 21:22:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:22:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: None. global_counter: 0
2024-09-30 21:22:24 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 1
2024-09-30 21:22:24 | INFO | stdout | INFO:     127.0.0.1:44038 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 21:22:24 | ERROR | stderr | /home/jack/anaconda3/envs/llavaplus/lib/python3.10/site-packages/transformers/generation/utils.py:1270: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation )
2024-09-30 21:22:24 | ERROR | stderr |   warnings.warn(
2024-09-30 21:22:28 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 21:22:30 | INFO | stdout | INFO:     127.0.0.1:57742 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 21:22:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 21:22:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 21:23:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 1
2024-09-30 21:23:08 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-09-30 21:23:08 | INFO | stdout | INFO:     127.0.0.1:34708 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 21:23:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 2
2024-09-30 21:23:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:23:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:23:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:24:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:24:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:24:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:24:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:25:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:25:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:25:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:25:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:26:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:26:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:26:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:26:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:27:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:27:17 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:27:29 | INFO | stdout | INFO:     127.0.0.1:42214 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 21:27:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:27:47 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:28:02 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:28:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:28:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:28:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:29:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:29:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:29:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:29:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:30:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:30:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:30:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:30:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:31:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:31:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:31:28 | INFO | stdout | INFO:     127.0.0.1:52752 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 21:31:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:31:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 2
2024-09-30 21:31:55 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 3
2024-09-30 21:31:55 | INFO | stdout | INFO:     127.0.0.1:52774 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 21:31:59 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 21:32:00 | INFO | stdout | INFO:     127.0.0.1:57198 - "POST /worker_get_status HTTP/1.1" 200 OK
2024-09-30 21:32:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 21:32:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 3
2024-09-30 21:32:32 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
2024-09-30 21:32:32 | INFO | stdout | INFO:     127.0.0.1:49142 - "POST /worker_generate_stream HTTP/1.1" 200 OK
2024-09-30 21:32:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=4, locked=False). global_counter: 4
2024-09-30 21:32:40 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:32:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:33:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:33:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:33:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:33:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:34:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:34:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:34:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:34:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:35:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:35:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:35:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:35:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:36:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:36:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:36:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:36:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:37:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:37:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:37:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:37:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:38:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:38:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:38:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:38:48 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:39:03 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:39:18 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:39:33 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:39:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:40:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:40:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:40:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:40:49 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:41:04 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:41:19 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4
2024-09-30 21:41:34 | INFO | model_worker | Send heart beat. Models: ['merge_med_llava_3']. Semaphore: Semaphore(value=5, locked=False). global_counter: 4