Modelofficial release

ibm-granite/granite-4.2-8b-q4-mlx

ibm-granite/granite-4.2-8b-q4-mlx →Hugging Face ↗
Parameters8.8B
Context128K
Input → output–
Licenseapache-2.0
PrecisionU32 · q4
ArchitectureGraniteForCausalLM
ReleasedSep 1, 2026
Downloads642

Based on ibm-granite/granite-4.2-8b

Other sizes and formats in the family

ModelParamsPrecisionDownloads
ibm-granite/granite-4.2-30b-bf16-mlx30B–409
ibm-granite/granite-4.2-30b-GGUFgguf30B–255K
ibm-granite/granite-4.2-30b-q4-mlxq430B–638
ibm-granite/granite-4.2-30b-q8-mlxq830B–505
ibm-granite/granite-4.2-30b29.3BBF1636.6K
ibm-granite/granite-4.2-30b-fp8fp829.3BF8_E4M31.8K
ibm-granite/granite-4.2-30b-nvfp4nvfp416.8BU82.9K
ibm-granite/granite-4.2-30b-mxfp4mxfp415.9BU8920
ibm-granite/granite-4.2-8b8.8BBF16127.2K
ibm-granite/granite-4.2-8b-fp8fp88.8BF8_E4M32.4K
ibm-granite/granite-4.2-8b-bf16-mlx8B–443
ibm-granite/granite-4.2-8b-GGUFgguf8B–268.3K
ibm-granite/granite-4.2-8b-q8-mlxq88B–523
ibm-granite/granite-4.2-8b-nvfp4nvfp45.3BU81.7K
ibm-granite/granite-4.2-8b-mxfp4mxfp45.1BU81K
ibm-granite/granite-4.2-3b3.7BBF1646.9K
ibm-granite/granite-4.2-3b-fp8fp83.7BF8_E4M31.1K
ibm-granite/granite-4.2-3b-mxfp4mxfp43.7BU8916
ibm-granite/granite-4.2-3b-nvfp4nvfp43.7BU81.1K
ibm-granite/granite-4.2-3b-q4-mlxq43.7BU32762
ibm-granite/granite-4.2-3b-q8-mlxq83.7BU32489
ibm-granite/granite-4.2-3b-bf16-mlx3B–377
ibm-granite/granite-4.2-3b-GGUFgguf3B–263.7K

Compare side by side →

This release in the news

No coverage of this exact release yet.