Kim

Sunghokim

1 5 79

AI & ML interests

None yet

Recent Activity

updated a bucket 7 days ago

gemma-challenge/gemma-sunghokim

published a bucket 8 days ago

gemma-challenge/gemma-sunghokim

liked a Space 8 days ago

gemma-challenge/gemma-dashboard

View all activity

Organizations

updated a bucket 7 days ago

gemma-challenge/gemma-sunghokim

12.6 MB

published a bucket 8 days ago

gemma-challenge/gemma-sunghokim

12.6 MB

liked a Space 8 days ago

Fast Gemma Challenge

⚡

100

Multi-agent collab to make Gemma go brrr

reacted to SeaWolf-AI's post with ❤️🔥 8 days ago

Post

3422

We wrote up our run in The Fast Gemma Challenge — as vidraft-darwin — and wanted to share the recipe. 🙏

gemma-challenge/gemma-dashboard

Verified result: 510.58 TPS at PPL 2.3930 on a single A10G (fw188-ctk49-n64-patchbridge, re-run & VERIFIED). Honest note: on raw TPS there are faster runs (535+), but those went over the PPL bar and didn't verify — what we're proud of is the fastest result that keeps quality.

The recipe is already open, so we explained each piece: sliding-window W188, CTK49 kernel tuning, noprecache (honest, verifiable measurement), and an N64 synthetic warmup bridge that shrinks the public↔private gap (~15 TPS), plus INT4 + MTP K=7 + CUDA-graph capture. One rule: only stack quality-neutral speedups.

Huge thanks to @firfir-cast , @gemma-slayer , @chiku-inu , @kenyan-duma , @dixie-flatline and everyone who shared their experiments. Full write-up

👇
https://huggingface.co/blog/FINAL-Bench/fast-gemma