Text Generation
Transformers
Safetensors
llada2_moe
conversational
custom_code

Please add support for Apple silicon inference

#4
by Narutoouz - opened

Diffusion models will shine on apple silicon. Support Mlx community to add support for these diffusion models.
Please release mlx variants of this model.
Thankyou.

Hi @Narutoouz ,

DMax currently only supports the dInfer framework and the Hugging Face Transformers framework for inference. We are working on adding support for the SgLang framework and will continue to try supporting more inference engines in the future.

Sign up or log in to comment