LFS vs XET files?

#1
by severo - opened

What is the meaning of the LFS vs XET files number chart ? What does it measure? And, as the migration is now 100%, ie. all the repositories are stored with XeT, why do we still have LFS files?

Hey @severo great questions/points.

What is the meaning of the LFS vs XET files number chart ? What does it measure?

This was intended to show how many LFS files were left on Hugging Face (and correspondingly, how many LFS files had been converted to Xet-backed files).

And, as the migration is now 100%, ie. all the repositories are stored with XeT, why do we still have LFS files?

This discrepancy arose because migrating a repository to Xet did not mean that all LFS files in that repository were successfully migrated. I have not updated this since the repository migration was complete, but my understanding is that the team was doing a second sweep to ensure all files were migrated to Xet as part of ongoing QA. @sirahd could maybe speak to that better than I could at this stage.

Regardless, I'll keep this issue open because it reminds me that I should update this space to reflect that it was a point-in-time dashboard, not one that is constantly being updated.

Sign up or log in to comment