NM Testing

company

AI & ML interests

None defined yet.

Recent Activity

nm-autobot updated a model 2 days ago

nm-testing/w8a8_static_asym-e2e

nm-autobot published a model 2 days ago

nm-testing/w8a8_static_asym-e2e

nm-autobot updated a model 2 days ago

nm-testing/w8a8_dynamic_asym-e2e

View all activity

nm-testing 's models 559

nm-testing/tinyllama-w4a16-compressed

1B • Updated Oct 9, 2024 • 1.6k

nm-testing/tinyllama-fp8-dynamic-compressed

1B • Updated Oct 9, 2024 • 740

nm-testing/SmolLM-360M-Instruct-quantized.w4a16

0.4B • Updated Oct 9, 2024 • 2

nm-testing/SmolLM-135M-Instruct-quantized.w4a16

Text Generation • 0.2B • Updated Oct 9, 2024 • 11

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-channel-quantized

47B • Updated Oct 9, 2024 • 3

nm-testing/Meta-Llama-3-8B-Instruct-fp8-compressed

8B • Updated Oct 9, 2024 • 3

nm-testing/Phi-3-mini-128k-instruct-FP8

4B • Updated Oct 9, 2024 • 1.49k

nm-testing/Mixtral-8x7B-Instruct-v0.1-FP8-quantized

47B • Updated Oct 9, 2024 • 5

nm-testing/Mixtral-8x7B-Instruct-v0.1-W8A16-quantized

47B • Updated Oct 9, 2024 • 6

nm-testing/Mixtral-8x7B-Instruct-v0.1-W4A16-quantized

47B • Updated Oct 9, 2024 • 92

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2-asym

Text Generation • 1B • Updated Oct 9, 2024 • 107

nm-testing/Qwen2-1.5B-Instruct-FP8W8

Text Generation • 2B • Updated Oct 9, 2024 • 6.38k

nm-testing/Meta-Llama-3-8B-Instruct-W4A16-ACTORDER-compressed-tensors-test

Text Generation • 8B • Updated Oct 9, 2024 • 12

nm-testing/Meta-llama3-8b-Instruct-quant-FP8

Text Generation • 8B • Updated Oct 9, 2024 • 3

nm-testing/Meta-llama3-8b-Instruct-SmoothQuant-Fp8

Text Generation • 8B • Updated Oct 9, 2024 • 7

nm-testing/Meta-Llama-3-8B-Instruct-nonuniform-test

Text Generation • 8B • Updated Oct 9, 2024 • 40.6k

nm-testing/nonuniform

Text Generation • 8B • Updated Oct 9, 2024 • 2

nm-testing/Meta-Llama-3-8B-Instruct-Non-Uniform-compressed-tensors

Text Generation • 8B • Updated Oct 9, 2024 • 4

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-FP8-Channelwise-compressed-tensors

Text Generation • 8B • Updated Oct 9, 2024 • 30 • 2

nm-testing/Meta-Llama-3-8B-Instruct-FP8-K-V

Text Generation • 8B • Updated Oct 9, 2024 • 7

nm-testing/Qwen2-0.5B-Instruct

Text Generation • 0.6B • Updated Oct 9, 2024 • 11

nm-testing/Meta-Llama-3-8B-Instruct-W4A16-compressed-tensors-test

Text Generation • 8B • Updated Oct 9, 2024 • 19

nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test-bos

Text Generation • 8B • Updated Oct 9, 2024 • 7

nm-testing/Meta-Llama-3-8B-FP8-compressed-tensors-test

Text Generation • 8B • Updated Oct 9, 2024 • 20.7k

nm-testing/Meta-Llama-3-8B-Instruct-W4-Group128-A16-Test

Text Generation • 8B • Updated Oct 9, 2024 • 1

nm-testing/Meta-Llama-3-8B-Instruct-W8-Channel-A8-Dynamic-Per-Token-Test

Text Generation • 8B • Updated Oct 9, 2024 • 21

nm-testing/tinyllama-oneshot-w8a16-per-channel

Text Generation • 1B • Updated Oct 9, 2024 • 1.07k

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token-2048-Samples

Text Generation • 8B • Updated Oct 9, 2024 • 10

nm-testing/Meta-Llama-3-8B-Instruct-W8A8-Dyn-Per-Token

Text Generation • 8B • Updated Oct 9, 2024 • 10

nm-testing/llama-3-instruct-w8a8-dyn-per-token-test

Text Generation • 8B • Updated Oct 9, 2024 • 7