Google Project Astra
Summary
Google has rolled out Project Astra in Gemini Live, which brings real-time visual AI to mobile devices. The feature allows users to have multilingual conversations about anything seen and heard via a phone’s camera or screen sharing. This technology is available on Pixel 9 and Samsung Galaxy S25 devices, with Galaxy S25 owners getting the feature without an additional subscription.
The feature provides advanced camerabased analysis and expanded AIdriven interactions. Users can ask Gemini Live to analyze how many fingers they are holding up or identify what street they are on as their car passes through a city. However, early users have noted that the feature behaves more like a snapshot tool than a continuous live feed.
Additionally, Google has introduced screen sharing capabilities in Gemini, allowing users to share their screen and let the AI see whatever they are looking at. This can be useful for getting instant feedback on news articles, product comparisons, or discount codes.
Key Points
- Project Astra brings real-time visual AI to mobile devices
- Available on Pixel 9 and Samsung Galaxy S25 devices
- Galaxy S25 owners get the feature without an additional subscription
- Advanced camerabased analysis and expanded AIdriven interactions
- Feature behaves more like a snapshot tool than a continuous live feed
- Screen sharing capabilities in Gemini allow users to share their screen and let the AI see whatever they are looking at
- Google’s new AI mode in its search platform provides longer, more nuanced queries
- Concerns among independent publishers about traffic decline due to AI summaries
- Competition for talent in the AI industry is a growing concern
- Google is doubling down on building out robust AI technologies under the Gemini umbrella.
Translation
总结
谷歌在Gemini Live中推出了Project Astra，带来了实时视觉AI到移动设备。该功能允许用户通过手机摄像头或屏幕共享进行多语种对话讨论任何看到的和听到的事物。这项技术可在Pixel 9和Samsung Galaxy S25设备上使用，Galaxy S25拥有者可以不额外订阅就获得该功能。
关键点
- Project Astra将实时视觉AI带到了移动设备
- 可以在 Pixel 9 和 Samsung Galaxy S25 设备上使用
- Galaxy S25 拥有者可以不额外订阅就获得该功能
- 高级摄像机分析和扩展的AIdriven交互
- 这个功能更像是一个快照工具而不是一个连续的实时直播
- Gemini中增加了屏幕共享能力，允许用户分享他们的屏幕，让AI看到他们正在看的任何事物
- 谷歌在其搜索平台中的新AI模式提供了更多、更加深入的查询
- 独立出版商对流量下降的关切是由AI总结引起的
- AI行业的竞争人才是一项日益增长的关切
- 谷歌在Gemini下继续加强构建出强大的AI技术。
Reference:
https://www.youtube.com/watch?v=OEGyc2Md5w4