It combines a Whisper encoder with a Gemma 4 backbone and retains text and image inputs. A speaking assistant needs an external speech synthesiser and turn-handling logic.
The model card warns of uneven performance across languages, problems with noise and long recordings, and potentially incorrect tool calls. Team-reported scores do not guarantee the same performance in another application.