Unable to run on Collab
I tried to run vaultgemma on Google Colab, but I see the following error.
ValueError: The checkpoint you are trying to load has model type vaultgemma but Transformers does not recognize this architecture. This could be because of an issue with the checkpoint, or because your version of Transformers is out of date.
Am I missing something?
Thanks for your interest in the model! Support for VaultGemma was added to Transformers in a special release on top of v4.56.1, and will be present in v4.57.0 when that version is released.
In the meantime, you can use this command in Colab to install the special release of the library: pip install git+https://github.com/huggingface/transformers@v4.56.1-Vault-Gemma-preview
For more information, check the release notes for that version on GitHub: https://github.com/huggingface/transformers/releases/tag/v4.56.1-Vault-Gemma-preview
Hi @samairtimer ,
Could you please confirm if you tried with the latest transformers version and the command from previous comments. if you have any concerns , please let us know, and we will be happy to assist on this.
Thank you.
It worked! Thank you/
Could you have a look at https://huggingface.co/google/vaultgemma-1b/discussions/6