Modelofficial release

ibm-granite/granite-4.2-3b-q4-mlx

Parameters3.7B

Context128K

Input → output–

Licenseapache-2.0

PrecisionU32 · q4

ArchitectureGraniteForCausalLM

ReleasedSep 1, 2026

Downloads762

Based on ibm-granite/granite-4.2-3b

Other sizes and formats in the family

Model	Params	Precision	Downloads
ibm-granite/granite-4.2-30b-bf16-mlx	30B	–	409
ibm-granite/granite-4.2-30b-GGUFgguf	30B	–	255K
ibm-granite/granite-4.2-30b-q4-mlxq4	30B	–	638
ibm-granite/granite-4.2-30b-q8-mlxq8	30B	–	505
ibm-granite/granite-4.2-30b	29.3B	BF16	36.6K
ibm-granite/granite-4.2-30b-fp8fp8	29.3B	F8_E4M3	1.8K
ibm-granite/granite-4.2-30b-nvfp4nvfp4	16.8B	U8	2.9K
ibm-granite/granite-4.2-30b-mxfp4mxfp4	15.9B	U8	920
ibm-granite/granite-4.2-8b	8.8B	BF16	127.2K
ibm-granite/granite-4.2-8b-fp8fp8	8.8B	F8_E4M3	2.4K
ibm-granite/granite-4.2-8b-q4-mlxq4	8.8B	U32	642
ibm-granite/granite-4.2-8b-bf16-mlx	8B	–	443
ibm-granite/granite-4.2-8b-GGUFgguf	8B	–	268.3K
ibm-granite/granite-4.2-8b-q8-mlxq8	8B	–	523
ibm-granite/granite-4.2-8b-nvfp4nvfp4	5.3B	U8	1.7K
ibm-granite/granite-4.2-8b-mxfp4mxfp4	5.1B	U8	1K
ibm-granite/granite-4.2-3b	3.7B	BF16	46.9K
ibm-granite/granite-4.2-3b-fp8fp8	3.7B	F8_E4M3	1.1K
ibm-granite/granite-4.2-3b-mxfp4mxfp4	3.7B	U8	916
ibm-granite/granite-4.2-3b-nvfp4nvfp4	3.7B	U8	1.1K
ibm-granite/granite-4.2-3b-q8-mlxq8	3.7B	U32	489
ibm-granite/granite-4.2-3b-bf16-mlx	3B	–	377
ibm-granite/granite-4.2-3b-GGUFgguf	3B	–	263.7K

No coverage of this exact release yet.