nvidia/NVIDIA-NemotronLabs-VoiceChat-11B
11B • Updated • 1.16k • 375
🤝 Open to Collab
LH-Tech AI
LH-Tech-AI
AI & ML interests
Small AI and ML models. Trained by myself. Completely OpenSource. For you. | Reddit: https://www.reddit.com/user/LH-Tech_AI/
Recent Activity
new activity about 13 hours ago
SupraLabs/Supra2-100M-Base:question liked a model about 19 hours ago
nvidia/NVIDIA-NemotronLabs-VoiceChat-11B liked a model about 20 hours ago
SupraLabs/Supra2-NanoOrganizations
question
😔🔥 3
7
#3 opened 1 day ago
by 
nkthebass
liked a
model about 19 hours ago
liked a
model about 20 hours ago
published a
model about 20 hours ago
liked a
model about 21 hours ago
Kindly asking for a SupraLabs compute GPU grant in Runpod
5
#1 opened 2 days ago
by LH-Tech-AI
liked a
Space 1 day ago
liked a
model 1 day ago
liked a
model 2 days ago
reacted to their post with ❤️ 2 days ago
Post
2109
Hey community and sponsors!
We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens
For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.
We estimate the total cost of the pro and ultra models at around $600.
For Supra3 Flash Lite and Flash, we do not need sponsors.
If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!
Contact: here or on discord: lh_tech_ai
We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens
For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.
We estimate the total cost of the pro and ultra models at around $600.
For Supra3 Flash Lite and Flash, we do not need sponsors.
If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!
Contact: here or on discord: lh_tech_ai
- 14 replies
Question about compute
11
#2 opened 2 days ago
by LH-Tech-AI
Compute?
#3 opened 2 days ago
by LH-Tech-AI
Please find your own theme and brand
4
#1 opened 2 days ago
by LH-Tech-AI
reacted to Banaxi-Tech's post with 🔥 2 days ago
Post
1860
We're excited to release BananaMind 2 SLMoE, an experimental sequence-level mixture-of-experts model.
It uses only 8M parameters per message but has 25M total parameters, 13 experts (out of 64) are selected based on the message prefix and reused for the entire response.
We're testing with this sequence-level architecture to find out how big the capability loss actually is and how much of it can be fixed.
The long-term idea is that this could make very large sparse models usable on machines that can't fit them in RAM by putting the entire model (which is big) on disk and only loading the active parts into VRAM.
This architecture is still in research and shouldn't be used for production models.
We trained it on 60B tokens (of FineWeb-HQ, FineWeb-Edu, DCLM ,Cosmopedia v2, FineMath and NPSet-2) on 8 RTX Pro 6000s.
Check it out at BananaMind/BananaMind-2-SLMoE
Follow us for future models:
BananaMind
@vovaRL
@Banaxi-Tech
@DedeProGames
BananaMind 2 Pro in a few days. You've been waiting 22 days for it.
It uses only 8M parameters per message but has 25M total parameters, 13 experts (out of 64) are selected based on the message prefix and reused for the entire response.
We're testing with this sequence-level architecture to find out how big the capability loss actually is and how much of it can be fixed.
The long-term idea is that this could make very large sparse models usable on machines that can't fit them in RAM by putting the entire model (which is big) on disk and only loading the active parts into VRAM.
This architecture is still in research and shouldn't be used for production models.
We trained it on 60B tokens (of FineWeb-HQ, FineWeb-Edu, DCLM ,Cosmopedia v2, FineMath and NPSet-2) on 8 RTX Pro 6000s.
Check it out at BananaMind/BananaMind-2-SLMoE
Follow us for future models:
@vovaRL
@Banaxi-Tech
@DedeProGames
BananaMind 2 Pro in a few days. You've been waiting 22 days for it.
- 3 replies
liked a
model 2 days ago
liked a
Space 2 days ago
liked a
model 2 days ago
replied to their post 3 days ago
I would really like to help but i dont think my 5070 Ti will help much 😔
Thank you for your offer but we already have a dual system of 5060 ti 16gb and 5060 8gb. But thanks though ❤️🤗
replied to their post 3 days ago
already Supra3?
Not yet, we're just announcing a plan, that would take ~1-2 months
Correct 💯
reacted to their post with 🚀 3 days ago
Post
2109
Hey community and sponsors!
We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens
For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.
We estimate the total cost of the pro and ultra models at around $600.
For Supra3 Flash Lite and Flash, we do not need sponsors.
If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!
Contact: here or on discord: lh_tech_ai
We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens
For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.
We estimate the total cost of the pro and ultra models at around $600.
For Supra3 Flash Lite and Flash, we do not need sponsors.
If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!
Contact: here or on discord: lh_tech_ai
- 14 replies