Omar Kamali PRO
omarkamali
AI & ML interests
NLP & LLMs for low resource languages.
Recent Activity
new activity 30 days ago
omneity-labs/lid-benchmark:Add CommonLingua new activity 30 days ago
omneity-labs/lid-benchmark:Add CommonLingua repliedto their post about 2 months ago
Just sharing a little breakthrough with Gherbal LID where we managed to distinguish the 15 variants of Arabic with 6 variants above 90%, 10 variants above 85% accuracy, practically distinguishing Moroccan and Algerian (which overlap massively).
It also embraces the duality of MSA and arabic variants pioneered in ALDi by @AMR-KELEG et al.
Now we're only bottlenecked by the availability of high quality data for the low scoring variants such as Iraqi, Libyan, Sudanese, Adeni ...
More on Gherbal at:
https://omneitylabs.com/models/gherbal
Organizations
