TurboQuant on Consumer GPUs — 100K Context on RTX 3090, 64K on RTX 4070
🚀
1
Extend LLM context to 100K tokens on consumer GPUs
Ai-Engineering.at
ai-engineering-at
·
AI & ML interests
AI & ML & Docker & Ollama & lokal & legal
Recent Activity
liked a Space about 7 hours ago
ai-engineering-at/llama-cpp-turboquant-guide updated a Space 1 day ago
ai-engineering-at/llama-cpp-turboquant-guide published a Space 1 day ago
ai-engineering-at/llama-cpp-turboquant-guideOrganizations
liked a
Space about 7 hours ago
updated a
Space 1 day ago
published a
Space 1 day ago
liked a
model 5 days ago
updated a
Space 5 days ago
published a
Space 5 days ago
liked 9
models 19 days ago
MiniMaxAI/MiniMax-M2.5
Text Generation • 229B • Updated • 623k • • 1.33k
Crownelius/Crow-9B-HERETIC-4.6
9B • Updated • 129k • 248
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-NVFP4
Text Generation • 67B • Updated • 1.47M • 244
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-FP8
Text Generation • 124B • Updated • 1.06M • 214
LocoreMind/LocoTrainer-4B
Text Generation • 4B • Updated • 2.1k • 55
black-forest-labs/FLUX.2-klein-9b-kv
Image-to-Image • Updated • 14.1k • 141
laurent-maille/Valuoty-industry-plc-20B-V0.11Adapt
Updated • 1
ICSFR-HF-ORG-01/Valuoty-industry-plc-3B
Text Generation • 3B • Updated • 6 • 1
Jackrong/Qwen3.5-27B-Claude-4.6-Opus-Reasoning-Distilled
Image-Text-to-Text • 28B • Updated • 487k • 2.17k
liked a
dataset 19 days ago
liked a
Space 19 days ago
liked a
model 19 days ago
