INC4AI/Llama-3.1-8B-fp-w8g128x128-for-ut
8B • Updated • 22
Intel Neural Compressor
INC4AI
AI & ML interests
AI & ML interests
Recent Activity
updated a model about 1 hour ago
INCModel/Qwen3-32B-MXFP8-FP8ATTN-CT-AutoRound published a model about 1 hour ago
INCModel/Qwen3-32B-MXFP8-FP8ATTN-CT-AutoRound updated a model about 1 hour ago
INCModel/Qwen3-30B-A3B-Instruct-2507-MXFP8-FP8ATTN-CT-AutoRoundOrganizations
INC4AI/Qwen3-30B-A3B-Instruct-2507-W2A16-G128-AutoRound-Testonly
31B • Updated • 17
INC4AI/Qwen3-30B-A3B-Instruct-2507-Attn4bits-Mlp2bits-AutoRound-200iters-TestOnly
17B • Updated • 46
INC4AI/Qwen3-8B-MXFP8-AR
8B • Updated • 3.51k
INC4AI/GELab-Zero-4B-preview-Sico-Evolution-AutoRound
1B • Updated • 27
INC4AI/FastContext-1.0-4B-SFT-AutoRound
0.9B • Updated • 12 • 1
INC4AI/Qwen-Image-Bench-AutoRound
Updated
INC4AI/Qwen-Image-AutoRound-W4A16
Text-to-Image • 6B • Updated • 4
INC4AI/MiMo-V2.5-Pro-int4-mixed
139B • Updated • 10 • 1
INC4AI/Qwen3-0.6B-autoround-W4A16
0.2B • Updated • 10
INC4AI/LongCat-Next-int4-AutoRound
Any-to-Any • 44B • Updated • 8 • 2
INC4AI/GLM-5.1-int4-mixed-AutoRound
104B • Updated • 15 • 7
INC4AI/Qwen3-8B-MXFP8A16-LLMC-TEST-ONLY
8B • Updated • 10
INC4AI/Qwen3-8B-MXFP8-LLMC-TEST-ONLY
8B • Updated • 8
INC4AI/ds-r1-autoround-llmc-fp8
671B • Updated • 8
INC4AI/Qwen3-30B-A3B-Instruct-2507-FP8-2Layers
2B • Updated • 30 • 1
INC4AI/DeepSeek-Math-V2-int4-AutoRound
Text Generation • 3B • Updated • 5
INC4AI/unsloth-DeepSeek-R1-BF16-4Layers-Test-Only
15B • Updated • 4
INC4AI/Qwen3-8B-FP8_STATIC-FP8-Attn-LLMC-Test-Only
8B • Updated • 1.72k
INC4AI/Youtu-LLM-2B-int4-AutoRound
Text Generation • 0.5B • Updated • 4
INC4AI/WeDLM-8B-Instruct-int4-AutoRound
Text Generation • 1B • Updated • 8
INC4AI/LongCat-Flash-Thinking-2601-int4-mixed-AutoRound
Text Generation • 2B • Updated • 12 • 3
INC4AI/MiniMax-M2.1-int4-AutoRound
Text Generation • 1B • Updated • 6 • 1
INC4AI/Qwen2.5-0.5B-Instruct-FP8-Dynamic-LLMC-TEST-Only
0.5B • Updated • 3
INC4AI/ds-v32-exp-w4a16-test-only
3B • Updated • 3
INC4AI/DS-V3.2-fp8-w4a16-test-only
3B • Updated • 5
INC4AI/DeepSeek-R1_mxfp8
Updated
INC4AI/DeepSeek-V2-Lite-Chat-FP8-STATIC-ATTN-TEST-ONLY
16B • Updated • 3
INC4AI/DeepSeek-V2-Lite-Chat-BF16-FP8-STATIC-FP8-KV-TEST-ONLY
16B • Updated • 2.41k
INC4AI/DeepSeek-V2-Lite-Chat-Block-wise-FP8-Test-Only
16B • Updated • 8