fb700
/

chatglm-fitness-RLHF

Model card Files Files and versions Community

如何在多gpu上加载

#16

by jersonal - opened Sep 9, 2023

Sep 9, 2023

我想使用模型分布在2块gpu上加载，单个GPU（8G）无法加载fp16精度的。

fb700

Owner Sep 10, 2023

和glm一样挂载，相关问题请查询glm官方项目

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment