NM Testing

company

AI & ML interests

None defined yet.

Recent Activity

nm-autobot updated a model less than a minute ago

nm-testing/TinyLlama-1.1B-Chat-v1.0-gptq-awq-mixed-e2e

nm-autobot published a model 1 minute ago

nm-testing/TinyLlama-1.1B-Chat-v1.0-gptq-awq-mixed-e2e

nm-autobot updated a model 4 minutes ago

nm-testing/TinyLlama-1.1B-Chat-v1.0-kv_cache_default_gptq_tinyllama-e2e

View all activity

nm-testing 's models 498

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-uncompressed

1B • Updated Jan 14, 2025 • 245

nm-testing/TinyLlama-1.1B-Chat-v1.0-W4A16-G128-compressed

0.3B • Updated Jan 14, 2025 • 323

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-uncompressed

1B • Updated Jan 14, 2025 • 238

nm-testing/TinyLlama-1.1B-Chat-v1.0-FP8-Dynamic-compressed

1B • Updated Jan 14, 2025 • 319

nm-testing/granite-3.1-3b-a800m-instruct-w4a16

3B • Updated Jan 9, 2025 • 2

nm-testing/DeepSeek-V2.5-1210-quantized.w4a16

32B • Updated Jan 7, 2025 • 2

nm-testing/llama-2-7b-sparse2of4

7B • Updated Jan 4, 2025 • 6

nm-testing/test-w4a16-mixtral-actorder-group

6B • Updated Dec 26, 2024 • 1.22k

nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-BitMask

22.2M • Updated Dec 19, 2024 • 2

nm-testing/llama2.c-stories15M-gsm8k-pruned.2of4-Uncompressed

24.4M • Updated Dec 19, 2024 • 2

nm-testing/gemma-2-9b-it-FP8-dynamic-KV

10B • Updated Dec 18, 2024 • 2

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM

5B • Updated Dec 17, 2024 • 2

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM

5B • Updated Dec 17, 2024 • 2

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM

5B • Updated Dec 17, 2024 • 2

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM

5B • Updated Dec 17, 2024 • 2

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM

5B • Updated Dec 17, 2024 • 1

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM

5B • Updated Dec 17, 2024 • 2

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 8

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_int8-BitM

5B • Updated Dec 17, 2024 • 2

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_tensor_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 8

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 10

nm-testing/SparseLlama-3.1-8B-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_fp8-BitM

5B • Updated Dec 17, 2024 • 2

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-tensor_wts_per_tok_dyn_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 7

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 8

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_tensor_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 8

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_fp8-BitM

0.7B • Updated Dec 17, 2024 • 8

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-chnl_wts_per_tok_dyn_act_int8-BitM

0.7B • Updated Dec 17, 2024 • 10

nm-testing/TinyLlama-1.1B-Chat-v1.0-gsm8k-pruned.2of4-Uncompressed

1B • Updated Dec 17, 2024 • 2

nm-testing/pixtral-12b-w4a16-actorder-weight

3B • Updated Dec 16, 2024 • 2

nm-testing/pixtral-12b-w8a8-noactorder

13B • Updated Dec 16, 2024 • 2