tech

Google’s Genie world model can now simulate real streets with Street View

Google DeepMind is integrating Street View with Project Genie to create immersive, interactive world simulations for robotics, gaming, and travel, allowing users to explore environments, weather changes, and rare scenarios.

Google’s Genie world model can now simulate real streets with Street View

TL;DR

  • Google DeepMind has connected its general-purpose world model, Project Genie, with Street View data.
  • This integration allows users to generate diverse, interactive simulations of real-world streets and their environments.
  • Users can adjust elements like weather conditions or simulate hypothetical scenarios.
  • The technology aims to benefit robotics training, gaming, and educational experiences.
  • Genie 3 is already being used in Waymo's simulators for self-driving car training.
  • Google has collected over 280 billion Street View images across 110 countries in 20 years.
  • The feature is rolling out to Google Ultra subscribers in the U.S. and globally.
  • While impressive, the simulations are currently video-game quality, lack physics awareness, and are considered experimental.
  • Key advancements include spatial continuity, allowing for accurate 360-degree environment simulation.
  • Google aims to improve accuracy and physics understanding in future iterations.