7 contributors

History: 18 commits

RangiLyu

x54-729

fast tokenizer and stream_chat fix (#7)

d0438da verified 8 months ago

.gitattributes

3.09 kB

use bin instead of safetensors with max shard of 2GB 8 months ago
README.md

10.9 kB

Update license in README.md 8 months ago
config.json

858 Bytes

fast tokenizer and stream_chat fix (#7) 8 months ago
configuration_internlm2.py

7.02 kB

fast tokenizer and stream_chat fix (#7) 8 months ago
generation_config.json

132 Bytes

use bin instead of safetensors with max shard of 2GB 8 months ago
modeling_internlm2.py

60 kB

fast tokenizer and stream_chat fix (#7) 8 months ago
pytorch_model-00001-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.92 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00002-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00003-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00004-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00005-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00006-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00007-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00008-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00009-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00010-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00011-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00012-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00013-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00014-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00015-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00016-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00017-of-00021.bin
Detected Pickle imports (3)
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage",
- "collections.OrderedDict"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00018-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.HalfStorage"
What is a pickle import?
1.94 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00019-of-00021.bin
Detected Pickle imports (3)
- "collections.OrderedDict",
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2"
What is a pickle import?
1.96 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00020-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.56 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model-00021-of-00021.bin
Detected Pickle imports (3)
- "torch.HalfStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.14 GB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
pytorch_model.bin.index.json

27.2 kB
LFS

use bin instead of safetensors with max shard of 2GB 8 months ago
special_tokens_map.json

95 Bytes

initial commit internlm2-chat-20b model 8 months ago
tokenization_internlm2.py

8.81 kB

fast tokenizer and stream_chat fix (#7) 8 months ago
tokenization_internlm2_fast.py

7.72 kB

fast tokenizer and stream_chat fix (#7) 8 months ago
tokenizer.model

1.48 MB
LFS

initial commit internlm2-chat-20b model 8 months ago
tokenizer_config.json

2.23 kB

fast tokenizer and stream_chat fix (#7) 8 months ago

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)

Detected Pickle imports (3)