8 contributors

History: 21 commits

x54-729

fix no white space when using stream_chat with fast tokenizer

71f7e15 9 months ago

.gitattributes

3.02 kB

update .gitattributes 11 months ago
README.md

11.5 kB

Update license in Readme.md 11 months ago
config.json

858 Bytes

fast tokenizer and stream_chat fix (#3) 10 months ago
configuration_internlm2.py

7.02 kB

fast tokenizer and stream_chat fix (#3) 10 months ago
generation_config.json

132 Bytes

initial commit internlm2-chat-20b-sft model 11 months ago
modeling_internlm2.py

60 kB

small 10 months ago
pytorch_model-00001-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.92 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00002-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00003-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00004-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00005-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00006-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00007-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00008-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00009-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00010-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00011-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00012-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00013-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00014-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00015-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00016-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00017-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00018-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00019-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00020-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.56 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model-00021-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.14 GB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
pytorch_model.bin.index.json

27.2 kB

initial commit internlm2-chat-20b-sft model 11 months ago
special_tokens_map.json

257 Bytes

Add special tokens for chat 9 months ago
tokenization_internlm2.py

8.81 kB

fast tokenizer and stream_chat fix (#3) 10 months ago
tokenization_internlm2_fast.py

7.81 kB

fix no white space when using stream_chat with fast tokenizer 9 months ago
tokenizer.model

1.48 MB
LFS

initial commit internlm2-chat-20b-sft model 11 months ago
tokenizer_config.json

2.4 kB

Add special tokens for chat 9 months ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)