thrunlab
/

sparse_sparse_80_percent_pretraining_warmup

Model card Files Files and versions

sparse_sparse_80_percent_pretraining_warmup

564 MB

1 contributor

History: 24 commits

lukeleeai's picture

Training in progress, step 950

5244ec7 verified about 2 years ago

.gitattributes

1.52 kB

initial commit about 2 years ago
adapter_config.json

636 Bytes

Training in progress, step 50 about 2 years ago
adapter_model.safetensors

562 MB
xet

Training in progress, step 950 about 2 years ago
special_tokens_map.json

437 Bytes

Training in progress, step 50 about 2 years ago
tokenizer.json

1.8 MB

Training in progress, step 50 about 2 years ago
tokenizer_config.json

918 Bytes

Training in progress, step 50 about 2 years ago
training_args.bin
Detected Pickle imports (11)
- "torch.device",
- "transformers.training_args.OptimizerNames",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SchedulerType",
- "accelerate.utils.dataclasses.DistributedType",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.trainer_utils.HubStrategy",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.training_args.TrainingArguments",
- "torch.float16"
How to fix it?
6.07 kB
xet

Training in progress, step 50 about 2 years ago