Gemini Omni: Revolutionizing AI Video Creation and Editing

The initial release from the Gemini Omni family is Gemini Omni Flash. This model is engineered to create virtually anything from any input, with a primary focus on video. Gemini Omni Flash empowers users to combine images, audio, video, and text to generate high-quality videos that are grounded in Gemini's extensive real-world knowledge. This means the generated content is not only visually impressive but also contextually relevant and coherent. The model's ability to understand and apply real-world physics further enhances the realism and believability of the created videos.

Gemini Omni excels at bringing creative ideas to life by grounding them in Gemini's vast world knowledge. It goes beyond mere photorealism by incorporating an intuitive understanding of physics, history, science, and cultural context. This allows for the creation of scenes with accurate physics, such as marbles rolling in a continuous chain reaction. Furthermore, Omni blends knowledge and creativity by connecting language, imagery, and meaning in sophisticated ways, moving beyond simple pattern matching. It can also generate compelling explainers for complex ideas, visualizing them through various styles like claymation. The model's ability to generate visuals with more accurate physics, like gravity and fluid dynamics, ensures a higher degree of realism in generated scenes.

Users can define the visual language of their videos by providing input references or simply describing their desired aesthetic in natural language. Gemini Omni seamlessly blends these inputs to create cohesive clips. This includes applying specific styles, motion sequences, or visual effects. For instance, a user can request animated motion effects to be added to a skateboard video or have the motion of a whale swimming applied to a fluid reflective material, forming a whale-like shape without explicitly showing the whale or water. This capability allows for intricate control over the final visual output, enabling users to achieve highly specific creative visions.

Gemini Omni Flash is rolling out starting today to Google AI Plus, Pro, and Ultra subscribers globally via the Gemini app and Google Flow. It is also available at no cost to users on YouTube Shorts and the YouTube Create App. In the coming weeks, access will be extended to developers and enterprise customers through APIs. Google plans to further expand output modalities to include image and audio generation in the future, continuing to enhance the capabilities of the Omni model family.