Google unveils enhanced Gemini Nano AI for Pixel 9 series

Key Points:

• Pixel 9 to Introduce Advanced Gemini Nano: Google has revealed plans to enhance its Gemini Nano AI for the upcoming Pixel 9 series, bringing multimodal capabilities that can interpret context from various inputs.
• Expanded Functionality: The upgraded Gemini Nano promises to go beyond text processing, demonstrating its ability to analyze real-world scenes captured by the device’s camera and provide accurate contextual understanding.
• Compatibility Concerns: While the new AI tool will debut with the Pixel 9, its compatibility with older Pixel models remains uncertain, as it necessitates newer hardware components such as Neural Processing Units (NPUs) and increased RAM.

Google unveiled at its annual developer conference, Google I/O, its intention to introduce an upgraded iteration of its Gemini Nano AI for the forthcoming Pixel 9 series. This enhanced version boasts a slew of new features, including the ability to interpret context from a variety of inputs such as images, videos, sounds, and spoken language. Unlike its predecessor, the new Gemini Nano requires beefier hardware, specifically Neural Processing Units (NPUs), potentially rendering it incompatible with older Pixel models.

Gemini Nano, essentially a miniature version of Google’s advanced generative AI model Gemini (formerly known as Bard), currently powers certain on-device AI functionalities on Pixel 8 series smartphones. These include the Summarize feature in the Recorder app and Smart Reply in Gboard. However, its capabilities have been largely confined to processing text inputs until now.

The unveiling teaser showcased Gemini Nano’s newfound ability to describe scenes captured by the Pixel 9’s camera, engaging in a conversational exchange to provide insights into the observed environment. This expanded functionality marks a significant leap forward, particularly for accessibility features like TalkBack, which Google aims to enhance for users with blindness or low vision.

Despite the excitement surrounding the upgraded Gemini Nano, concerns loom regarding its compatibility with older Pixel models. Google’s announcement hinted at the necessity of newer hardware components for the AI tool’s operation, suggesting that it may not be compatible with previous Pixel iterations. However, the company also hinted at ongoing efforts to develop compact AI models for broader device compatibility, with more details expected to emerge in the coming months leading up to the Pixel 9 series release.