LH-Tech-AI (LH-Tech AI)

reacted to their post with ❤️ 2 days ago

Post

2127

Hey community and sponsors!

We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens

For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.

We estimate the total cost of the pro and ultra models at around $600.

For Supra3 Flash Lite and Flash, we do not need sponsors.

If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!

Contact: here or on discord: lh_tech_ai

14 replies

·

reacted to Banaxi-Tech's post with 🔥 2 days ago

Post

1865

We're excited to release BananaMind 2 SLMoE, an experimental sequence-level mixture-of-experts model.
It uses only 8M parameters per message but has 25M total parameters, 13 experts (out of 64) are selected based on the message prefix and reused for the entire response.
We're testing with this sequence-level architecture to find out how big the capability loss actually is and how much of it can be fixed.
The long-term idea is that this could make very large sparse models usable on machines that can't fit them in RAM by putting the entire model (which is big) on disk and only loading the active parts into VRAM.
This architecture is still in research and shouldn't be used for production models.

We trained it on 60B tokens (of FineWeb-HQ, FineWeb-Edu, DCLM ,Cosmopedia v2, FineMath and NPSet-2) on 8 RTX Pro 6000s.

Check it out at BananaMind/BananaMind-2-SLMoE
Follow us for future models:

BananaMind
@vovaRL
@Banaxi-Tech
@DedeProGames

BananaMind 2 Pro in a few days. You've been waiting 22 days for it.

3 replies

·

replied to their post 3 days ago

I would really like to help but i dont think my 5070 Ti will help much 😔

Thank you for your offer but we already have a dual system of 5060 ti 16gb and 5060 8gb. But thanks though ❤️🤗

replied to their post 3 days ago

already Supra3?

Not yet, we're just announcing a plan, that would take ~1-2 months

Correct 💯

reacted to their post with 🚀🔥 3 days ago

Post

2127

Hey community and sponsors!

We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens

For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.

We estimate the total cost of the pro and ultra models at around $600.

For Supra3 Flash Lite and Flash, we do not need sponsors.

If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!

Contact: here or on discord: lh_tech_ai

14 replies

·

posted an update 3 days ago

Post

2127

Hey community and sponsors!

We are announcing the Supra3 family with four core SLM models:
- Supra3 Flash Lite: 25M parameters, ~60B pretraining tokens
- Supra3 Flash: 50M parameters, ~100B pretraining tokens
- Supra3 Pro: 75M parameters, ~150B pretraining tokens
- Supra3 Ultra: 100M parameters, ~200B pretraining tokens

For Supra3 Pro and Ultra, we search for sponsors who give us free access to compute like RTX 5090 32GB or so.

We estimate the total cost of the pro and ultra models at around $600.

For Supra3 Flash Lite and Flash, we do not need sponsors.

If anyone would apply for helping us, we would be really thankful and this person would get early access to new modele, insider information, credit and more!

Contact: here or on discord: lh_tech_ai

14 replies

·

reacted to wop's post with 🤗 6 days ago

Post

2305

🧪 SlopFinder is here!!

We're building a dataset to study what humans actually consider AI slop.

SlopFinder shows you a random piece of AI-generated text and gives you one simple control: **how slop is it?**
No categories. No complicated forms. Just vote and move on.

Every vote helps build the dataset. 🧩

How does it work?
Samples are pulled from existing datasets, shown anonymously, and collected into our annotation pool. After enough votes, they're exported to Hugging Face for everyone to use.

This is an early MVP, so the dataset is small and the system is still evolving.

Vote here:
https://bench-labs.web.app/slopfinder.html
(refresh page if you want to skip)

Dataset:
bench-labs/slop-classification

@benchlabs

17 replies

·

reacted to Banaxi-Tech's post with 🔥 7 days ago

Post

1225

BananaMind 2 Pro got better!
Release on August 13-14
Follow our team for BananaMind 2 Ultra:
@vovaRL for training code
@Banaxi-Tech
@DedeProGames for providing compute

BananaMind

Want to become a previewer?
👇

BananaMind-Model-Previewers

3 replies

·

reacted to Enderchef's post with 👍 9 days ago

Post

3255

GPT-X2.5-135M is finally released! 🚀
The new flagship from Axiomic Labs takes 3rd on the open SLM leaderboard trailing only the SmolLMs, check it out and follow us:
AxiomicLabs/GPT-X2.5-135M

2 replies

·

replied to their post 10 days ago

It's out!

reacted to their post with 🤯🚀🔥 11 days ago

Post

3467

Supra2-100M is out!
Go check it out:
- https://www.reddit.com/r/LocalLLaMA/comments/1velyl9/new_models_supra2100m_base_and_instruct_go_check/
- https://huggingface.co/SupraLabs/Supra2-100M
- SupraLabs/Supra2-100M-Instruct

Give us a like and a follow!!

HAVE FUN 🤗🔥🚀
more coming soon...

1 reply

·

posted an update 11 days ago

Post

3467

Supra2-100M is out!
Go check it out:
- https://www.reddit.com/r/LocalLLaMA/comments/1velyl9/new_models_supra2100m_base_and_instruct_go_check/
- https://huggingface.co/SupraLabs/Supra2-100M
- SupraLabs/Supra2-100M-Instruct

Give us a like and a follow!!

HAVE FUN 🤗🔥🚀
more coming soon...

1 reply

·

replied to their post 12 days ago

Hey guys!
Supra2-100M base is delayed by another 4 hours. So it will be released at around 17PM in german time.
Why? Because we're running some tests, improving quality and tuning the model to deliver you the best quality possible! 🔥🤗
Stay tuned!
Instruction tuned model coming this evening (around 20PM in german time)! 😁

replied to their post 12 days ago

This comment has been hidden

replied to their post 12 days ago

i will benchmark later. i am doing the SFT data right now 🤗

replied to their post 12 days ago

lol. okay

reacted to their post with 🔥 12 days ago

Post

2394

Announcing The Supra2 Family And Supra2-100M

Today, we are announcing a brand-new series of SupraLabs models: Supra2
This series will feature various models, including such as:
- 🐜 Supra2-Nano (0.4M) → The smallest Supra2 model.
- 🤏 Supra2-Small (1.4M) → The tiny model that runs everywhere.
- 💪 Supra2-Medium (25M) → Our medium class model in the Supra2 family. The powerful midsizer.
- 🔥 Supra2-Pro (100M): base, instruct, reasoning, code, math and more! → The most capable model yet! A real allrounder for all your everyday tasks.
- 🎨 Supra2-IMG → our generative text-to-image model
...and many more...

Current progress:
- Nano (0.4M) and Small (1.4M): in training; almost done. Baseline set.
- Medium (25M): coming soon...
- Pro (100M): in training; finishes in 66 hours - Monday, 3rd August 2026, 12:00AM
- IMG: coming soon...

You can support us with a like and follow if you want!
Don't miss our next release! Stay tuned...

30 replies

·

LH-Tech AI

AI & ML interests

Recent Activity

Organizations

LH-Tech AI

AI & ML interests

Recent Activity

Organizations

LH-Tech-AI's activity