Google Launches Immersive Street View Experience with Project Genie Integration

Google DeepMind is enhancing its Street View feature by integrating it with Project Genie, which was presented at the Google I/O developer conference. This new functionality allows users to have an interactive and immersive experience, simulating environments and altering conditions such as weather.

• Key Goals and Examples: With this integration, the aim is to provide a robust tool for both human users and robotic simulations. For instance, Genie can simulate rare weather conditions in London or show New York City under snow.
• Data Collection: Over 20 years, Google has collected 280 billion images from 110 countries via vehicles and individuals with tracker backpacks.
• Applications and Impact: Genie is poised to assist educational experiences, gaming, and robotics training. It also enables Waymo to enhance its simulators for self-driving cars, preparing them for rare events globally.
• Current Limitations: Although the technology is impressive, it remains experimental, with certain limitations in accuracy and photorealism. The model doesn't yet incorporate physics awareness but is expected to advance within 6 to 12 months.
• Future Prospects: According to Google's Jonathan Herbert, the real innovation lies in the AI's ability to maintain spatial continuity and remember complex environments during 360-degree simulations.

The new feature is available to some Ultra users in the U.S. and will be rolled out globally in coming weeks. There are plans to further improve the feature, making it widely available and accurate for future AI research.