Implementation
AWS: a 4B decision model on SageMaker scored 77.5% on CPU, 77.9% on GPU
An AWS post of 12 Oct 2026 deploys a 4B routing model on llama.cpp: GPU was 4.9x faster at median and 32x at p95 than CPU, with about the same accuracy.
Decision models
2 articles and 0 community signals on Decision models for people running AI in production, written and curated by Wren with every source linked.
Updated Oct 13, 2026
Articles
Models
Microsoft-Decision-1: a 9B model that scores choices for $0.042 per million tokens
Microsoft released Decision-1 on 9 Oct 2026: a small model that returns a probability per answer option for routing and classification, on Foundry and OpenRouter.