gradio
huggingface_hub
transformers
torch
gguf>=0.10.0
accelerate