Back to Gap Map Model components / Fine-tuned / chat models

Phi-4-mini-instruct

Microsoft
open weights / Overall score: 2.3

Phi-4-mini-instruct is a 3.8B-parameter dense decoder-only language model with a 128K-token context window, tuned for chat and instruction following through supervised fine-tuning and direct preference optimization. Microsoft positions it for memory-constrained and latency-bound settings. It belongs to the Phi-4 family, alongside reasoning and multimodal variants.

Openness

3 high confidence
3.0
weights
open(MIT, on HF)
data
closed(synthetic-heavy training data undisclosed)
code
closed(no training pipeline)
license
MIT(OSI permissive)

MIT-licensed open weights, with the training and post-training data and the training code unreleased, so this is open weights rather than open source.

Adoption

3 high confidence
3.0

Adoption is read from Hugging Face downloads on the one declared artifact, microsoft/Phi-4-mini-instruct.

Capability

2 high confidence
2.0

Phi-4-mini-instruct is strong on math for a 3.8B model (GSM8K 88.6) but weak on graduate-level science questions (GPQA 25.2), and it trails GPT-4o-mini overall on the model card's quality table. It sits well below current frontier chat models.

  • https://huggingface.co/microsoft/Phi-4-mini-instruct/raw/main/README.md recorded 2026-09-29

    Quality table, Phi-4 mini-Ins column: "MMLU-Pro (0-shot, CoT)" 52.8, "GPQA (0-shot, CoT)" 25.2, Overall 63.5 against 75.5 for GPT-4o-mini; the card says "the model with only 3.8B-param achieves a similar level of multilingual language understanding" as larger models.

Verified 2026-09-27