Article
Native-speed vLLM transformers modeling backend
hmellor, lysandre
• • 29
👋 Open to Work
Pratik
hackyroot
·
AI & ML interests
None yet
Recent Activity
upvoted an article 4 days ago
Native-speed vLLM transformers modeling backend upvoted an article 10 days ago
Continuous batching from first principles liked a model 13 days ago
prathoshap/vagdhenuOrganizations
upvoted an article 4 days ago
upvoted an article 10 days ago
Article
Continuous batching from first principles
- +1
ror, ArthurZ, mcpotato
• • 422