Update README.md

README.md

@@ -17,7 +17,7 @@ Converted and quantized checkpoint of [nvidia/Nemotron-4-340B-Instruct](https://
 
 You can deploy this model with `vllm>=0.5.4` ([PR#6611](https://github.com/vllm-project/vllm/pull/6611)):
 ```
-vllm serve mgoin/Nemotron-4-340B-Instruct-hf --tensor-parallel-size 16
+vllm serve mgoin/Nemotron-4-340B-Instruct-hf-FP8 --tensor-parallel-size 8
 ```
 
 ### Evaluations