YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details.
AI & ML interests
None defined yet.
https://github.com/Cornell-RelaxML/quip-sharp
-
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 6 -
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation β’ 5B β’ Updated β’ 2 -
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation β’ 1B β’ Updated β’ 17 -
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 38
YAQA hessians (Sketch B) and models with the QTIP quantizer. See https://github.com/Cornell-RelaxML/yaqa/tree/main for more details.
https://github.com/Cornell-RelaxML/quip-sharp
-
relaxml/Llama-2-7b-chat-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 6 -
relaxml/Llama-2-70b-E8PRVQ-4Bit
Text Generation β’ 5B β’ Updated β’ 2 -
relaxml/Llama-2-13b-E8PRVQ-4Bit
Text Generation β’ 1B β’ Updated β’ 17 -
relaxml/Llama-2-7b-E8PRVQ-4Bit
Text Generation β’ 0.7B β’ Updated β’ 38
See https://github.com/Cornell-RelaxML/qtip