Google DeepMind 发布 Genie 4,这是其首个带原生音频的实时世界模型,可生成环境音、音乐和角色实时对话,角色会回应用户与场景内事件。用户可通过输入文字改写运行中的模拟,例如改变天气、移动镜头或添加人物,Gemini 会把每次编辑融入场景并保持连贯。
Genie 4 is Google DeepMind’s first real-time world model with native audio, generating ambient sound, music and live dialogue from characters who react to users and in-world events.
Users can rewrite a running simulation by typing, changing weather, moving the camera or adding people, while Gemini fits each edit to the scene and keeps it coherent.
Gemini 3.8 Flash acts as an in-loop director, splitting goals into steps and checking incoming frames, and Gemini 4 Argon used that loop to simulate Apptronik’s Apollo humanoid playing checkers.
access starts with trusted testers before Google AI Ultra subscribers and early Gemini API partners. https://x.com/sundarpichai/status/2115115252690145519/video/1
来源:Rohan Paul · x.com