Open
Description
RuntimeError: The weights trying to be saved contained shared tensors [{'cls.predictions.decoder.weight', 'bert.embeddings.word_embeddings.weight'}] that are mismatching the transformers base configuration. Try saving using safe_serialization=False
or remove this tensor sharing.
When I run run_mlm.py, the following error occurs during train_result = trainer.train(resume_from_checkpoint=checkpoint):
I’m using the configuration zhihan1996/DNABERT-2-117M and the BertForMaskedLM model from bert_layers.py.
Metadata
Metadata
Assignees
Labels
No labels