Update README.md

README.md

@@ -85,56 +85,7 @@ response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
 
 To handle extensive inputs exceeding 32,768 tokens, we utilize [YARN](https://arxiv.org/abs/2309.00071), a technique for enhancing model length extrapolation, ensuring optimal performance on lengthy texts.
 
-For deployment, we recommend using vLLM. You can enable the long-context capabilities by following these steps:
-
-1. **Install vLLM**: You can install vLLM by running the following command.
-
-    ```bash
-    pip install "vllm>=0.4.3"
-    ```
-    
-    Or you can install vLLM from [source](https://github.com/vllm-project/vllm/).
-
-2. **Configure Model Settings**: After downloading the model weights, modify the `config.json` file by including the below snippet:
-    ```json
-        {
-            "architectures": [
-                "Qwen2ForCausalLM"
-            ],
-            // ...
-            "vocab_size": 152064,
-
-            // adding the following snippets
-            "rope_scaling": {
-                "factor": 4.0,
-                "original_max_position_embeddings": 32768,
-                "type": "yarn"
-            }
-        }
-    ```
-    This snippet enable YARN to support longer contexts.
-
-3. **Model Deployment**: Utilize vLLM to deploy your model. For instance, you can set up an openAI-like server using the command:
-
-    ```bash
-    python -m vllm.entrypoints.openai.api_server --served-model-name Qwen2-32B-Instruct --model path/to/weights
-    ```
-
-    Then you can access the Chat API by:
-
-    ```bash
-    curl http://localhost:8000/v1/chat/completions \
-        -H "Content-Type: application/json" \
-        -d '{
-        "model": "Qwen2-32B-Instruct",
-        "messages": [
-            {"role": "system", "content": "You are a helpful assistant."},
-            {"role": "user", "content": "Your Long Input Here."}
-        ]
-        }'
-    ```
-
-    For further usage instructions of vLLM, please refer to our [Github](https://github.com/QwenLM/Qwen2).
+For deployment, we recommend using vLLM. Please refer to our [Github](https://github.com/QwenLM/Qwen2.5) for usage if you are not familar with vLLM.
 
 **Note**: Presently, vLLM only supports static YARN, which means the scaling factor remains constant regardless of input length, **potentially impacting performance on shorter texts**. We advise adding the `rope_scaling` configuration only when processing long contexts is required.