Modelofficial release

ibm-granite/granite-4.2-8b-GGUF

Parameters8B

Context–

Input → output–

Licenseapache-2.0

Precisiongguf

Architecture–

ReleasedAug 12, 2026

Downloads268.3K

Based on ibm-granite/granite-4.2-8b

Other sizes and formats in the family

Model	Params	Precision	Downloads
ibm-granite/granite-4.2-30b-bf16-mlx	30B	–	409
ibm-granite/granite-4.2-30b-GGUFgguf	30B	–	255K
ibm-granite/granite-4.2-30b-q4-mlxq4	30B	–	638
ibm-granite/granite-4.2-30b-q8-mlxq8	30B	–	505
ibm-granite/granite-4.2-30b	29.3B	BF16	36.6K
ibm-granite/granite-4.2-30b-fp8fp8	29.3B	F8_E4M3	1.8K
ibm-granite/granite-4.2-30b-nvfp4nvfp4	16.8B	U8	2.9K
ibm-granite/granite-4.2-30b-mxfp4mxfp4	15.9B	U8	920
ibm-granite/granite-4.2-8b	8.8B	BF16	127.2K
ibm-granite/granite-4.2-8b-fp8fp8	8.8B	F8_E4M3	2.4K
ibm-granite/granite-4.2-8b-q4-mlxq4	8.8B	U32	642
ibm-granite/granite-4.2-8b-bf16-mlx	8B	–	443
ibm-granite/granite-4.2-8b-q8-mlxq8	8B	–	523
ibm-granite/granite-4.2-8b-nvfp4nvfp4	5.3B	U8	1.7K
ibm-granite/granite-4.2-8b-mxfp4mxfp4	5.1B	U8	1K
ibm-granite/granite-4.2-3b	3.7B	BF16	46.9K
ibm-granite/granite-4.2-3b-fp8fp8	3.7B	F8_E4M3	1.1K
ibm-granite/granite-4.2-3b-mxfp4mxfp4	3.7B	U8	916
ibm-granite/granite-4.2-3b-nvfp4nvfp4	3.7B	U8	1.1K
ibm-granite/granite-4.2-3b-q4-mlxq4	3.7B	U32	762
ibm-granite/granite-4.2-3b-q8-mlxq8	3.7B	U32	489
ibm-granite/granite-4.2-3b-bf16-mlx	3B	–	377
ibm-granite/granite-4.2-3b-GGUFgguf	3B	–	263.7K

No coverage of this exact release yet.