wu

vanewu's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

New activity in TMElyralab/lyraChatGLM over 1 year ago

OSError: libmpi.so.40: cannot open shared object file: No such file or directory

2

#42 opened over 1 year ago by dghjjjk

请问这个加速版本还支持原版模型的quantize接口吗，4bit和8bit量化

3

#11 opened over 1 year ago by goldenteethCN

Speed comparison with fastertransformer for ChatGLM?

2

#10 opened over 1 year ago by xiangli

how to generating glm.cpython-38-x86_64-linux-gnu.so

8

#2 opened over 1 year ago by SHAYINDAODSD

TensorRT version Error

4

#7 opened over 1 year ago by rayleee

Update lyraChatGLM/model.py

1

#21 opened over 1 year ago by dawnranger

Update requirements.txt

1

#20 opened over 1 year ago by dawnranger

RuntimeError: [FT][ERROR] Assertion fail: /group/30063/users/vanewu/FasterTransformer/src/fastertransformer/th_op/glm/GlmOp.h:462

1

#32 opened over 1 year ago by xtaos

OSError: /lyrachatglmtest/lyraChatGLM/ftlib/libth_transformer_sm80.so: undefined symbol: _ZN5torch3jit17parseSchemaOrNameERKNSt7__cxx1112basic_stringIcSt11char_traitsIcESaIcEEE

9

#34 opened over 1 year ago by xtaos

权重与original权重有区别？

3

#33 opened over 1 year ago by HennyWong

query长度影响首个token的预测时延

7

#23 opened over 1 year ago by rayleee

OSError: /lyraChatGLM/lyraChatGLM/libnvinfer_plugin.so: invalid ELF header

17

#8 opened over 1 year ago by Laity0806

ImportError: libcudart.so.12: cnnot open shared object file: No such file or directory

10

#13 opened over 1 year ago by zangao

OSError: libcudart.so.12: cannot open shared object file: No such file or directory

5

#25 opened over 1 year ago by betterme

about 310 tokens/s

6

#6 opened over 1 year ago by lchustc

Why not support Windows?

1

#12 opened over 1 year ago by Pevernow

About the relationship between glm6b-bs8.ftm and original chatglm6b weights

3

#14 opened over 1 year ago by thincal

About the 3090/4090/A10 device support

6

#15 opened over 1 year ago by thincal

NewAcceleration

1

#19 opened over 1 year ago by vanewu

NewAcceleration

#18 opened over 1 year ago by vanewu