inference-optimization/final-ctest-Qwen3-8B-speculator.dflash
2B • Updated • 88
Inference Optimization
community
AI & ML interests
None defined yet.
Recent Activity
View all activity
inference-optimization/qwen3_8b_7.0_bits_mode_noise_stiched
7B • Updated • 59
inference-optimization/qwen3_8b_7.0_bits_mode_hybrid_stiched
7B • Updated • 60
inference-optimization/qwen3_8b_7.0_bits_mode_heuristic_stiched
7B • Updated • 59
inference-optimization/qwen3_8b_6.5_bits_mode_noise_stiched
7B • Updated • 61
inference-optimization/qwen3_8b_6.5_bits_mode_hybrid_stiched
7B • Updated • 56
inference-optimization/qwen3_8b_6.5_bits_mode_heuristic_stiched
7B • Updated • 60
inference-optimization/qwen3_8b_6.0_bits_mode_noise_stiched
6B • Updated • 59
inference-optimization/qwen3_8b_6.0_bits_mode_hybrid_stiched
6B • Updated • 52
inference-optimization/qwen3_8b_6.0_bits_mode_heuristic_stiched
6B • Updated • 57
inference-optimization/qwen3_8b_5.5_bits_mode_noise_stiched
6B • Updated • 55
inference-optimization/qwen3_8b_5.5_bits_mode_hybrid_stiched
6B • Updated • 58
inference-optimization/qwen3_8b_5.5_bits_mode_heuristic_stiched
6B • Updated • 59
inference-optimization/qwen3_8b_5.0_bits_mode_noise_stiched
6B • Updated • 57
inference-optimization/qwen3_8b_5.0_bits_mode_hybrid_stiched
6B • Updated • 60
inference-optimization/qwen3_8b_5.0_bits_mode_heuristic_stiched
6B • Updated • 56
inference-optimization/llama3_8b_7.0_bits_mode_noise_stiched
7B • Updated • 30
inference-optimization/llama3_8b_7.0_bits_mode_hybrid_stiched
7B • Updated • 31
inference-optimization/llama3_8b_7.0_bits_mode_heuristic_stiched
7B • Updated • 27
inference-optimization/llama3_8b_6.5_bits_mode_noise_stiched
7B • Updated • 28
inference-optimization/llama3_8b_6.5_bits_mode_hybrid_stiched
7B • Updated • 29
inference-optimization/llama3_8b_6.5_bits_mode_heuristic_stiched
7B • Updated • 25
inference-optimization/llama3_8b_6.0_bits_mode_noise_stiched
6B • Updated • 31
inference-optimization/llama3_8b_6.0_bits_mode_heuristic_stiched
6B • Updated • 25
inference-optimization/llama3_8b_5.5_bits_mode_noise_stiched
6B • Updated • 30
inference-optimization/llama3_8b_5.5_bits_mode_hybrid_stiched
6B • Updated • 29
inference-optimization/llama3_8b_5.5_bits_mode_heuristic_stiched
6B • Updated • 23
inference-optimization/llama3_8b_5.0_bits_mode_noise_stiched
5B • Updated • 24
inference-optimization/llama3_8b_5.0_bits_mode_hybrid_stiched
5B • Updated • 27
inference-optimization/llama3_8b_5.0_bits_mode_heuristic_stiched
5B • Updated • 28