Essential Official Android Thread
It's wild how out of touch these companies are. Everybody I know hates it and apparently online too
Google to give app devs access to Gemini Nano for on-device AI
New APIs for Google’s ML Kit will let developers plug into the on-device AI model.
arstechnica.com
Google to give app devs access to Gemini Nano for on-device AI
New APIs for Google's ML Kit will let developers plug into the on-device AI model.
Ryan Whitwam – May 16, 2025 2:15 PM |
17
Credit: Thomas Fuller/SOPA Images/LightRocket via Getty Images
The rapid expansion of generative AI has changed the way Google and other tech giants design products, but most of the AI features you've used are running on remote servers with a ton of processing power. Your phone has a lot less power, but Google appears poised to give developers some important new mobile AI tools. At I/O next week, Google will likely announce a new set of APIs to let developers leverage the capabilities of Gemini Nano for on-device AI.
Google has quietly published documentation on big new AI features for developers. According to Android Authority, an update to the ML Kit SDK will add API support for on-device generative AI features via Gemini Nano. It's built on AI Core, similar to the experimental Edge AI SDK, but it plugs into an existing model with a set of predefined features that should be easy for developers to implement.
Google says ML Kit’s GenAI APIs will enable apps to do summarization, proofreading, rewriting, and image description without sending data to the cloud. However, Gemini Nano doesn't have as much power as the cloud-based version, so expect some limitations. For example, Google notes that summaries can only have a maximum of three bullet points, and image descriptions will only be available in English. The quality of outputs could also vary based on the version of Gemini Nano on a phone. The standard version (Gemini Nano XS) is about 100MB in size, but Gemini Nano XXS as seen on the Pixel 9a is a quarter of the size. It's text-only and has a much smaller context window.
Not all versions of Gemini Nano are created equal. Credit: Ryan Whitwam
This move is good for Android in general because ML Kit works on devices outside Google's Pixel line. While Pixel devices use Gemini Nano extensively, several other phones are already designed to run this model, including the OnePlus 13, Samsung Galaxy S25, and Xiaomi 15. As more phones add support for Google's AI model, developers will be able to target those devices with generative AI features.
The documentation is available for developers to peruse now, but we expect Google to fling the API doors open at I/O. The company has already confirmed an I/O session called "Gemini Nano on Android: Building with on-device gen AI." The description promises new APIs to "summarize, proofread, and rewrite text, as well as to generate image descriptions," which sounds exactly like what the new ML Kit APIs can do.
An important piece of the AI puzzle
App developers interested in adding on-device generative AI features on Android are currently in a tough spot. Google offers the AI Edge SDK that can provide access to the NPU hardware for running models, but these tools are experimental and only work on the Pixel 9 series currently. It's also limited to text. Both Qualcomm and MediaTek offer APIs for running AI workloads, but features and functionality vary by device, which makes it risky to rely on them for a long-term project. And running your own model requires intimate knowledge of generative AI systems. The new APIs should make implementing local AI comparatively quick and easy.
Despite the limited functionality of an on-device model, this is an important part of how AI could become more helpful. Most people would probably prefer not to send all their personal data to a remote server for AI processing, but an on-device model can parse that information in a more secure way. For example, Google's Pixel Screenshots sees all your screenshots, but all the processing happens on your phone. Similarly, Motorola summarizes notifications locally on the new Razr Ultra foldable. On the other hand, its less capable base model Razr sends notifications to a server for processing.
The release of APIs that plug into Gemini Nano could provide some much-needed consistency to mobile AI. However, it does rely on Google and OEMs to collaborate on support for Gemini Nano. Some companies might decide to go their own way, and there will be plenty of phones that don't have enough power to run AI locally.
Finally bought an android tablet after years of not having one. alldocube iplay 60 mini turbo. Been using it for a few different things. The Prince of Persia game is fun so far.
Using my Tab s10 Ulltra right now...bam...getting this oil change and waiting for the best of the BEST to be delivered.
Late to respond but I've been team pixel from day one. I've owned every one minus the 4 and the 8. I had the Nexus 6, LG Nexus 5 and 4, Samsung Galaxy Nexus etc. The pixel will always be that phone for me, even though there are more than a few things that Samsung does right. Since you been with Samsung so long I don't know if you'd like the Pixel more, however, if you don't mind the lack of S Pen and the way Samsung saturates they're photos (in a good way), then I think you'd enjoy owning the Pixel fold. I do believe you lose some with the camera but that is the same with both foldable devices (Pixel and Samsung).What's our thoughts on the pixel? I've only owned a Nexus 6P from Google and have had about eight galaxy devices starting with the very first one. Don't love the bloatware on Sammy devices and I LOVED my 6p but I hate the name "pixel" and have heard from several reviewers they don't quite live up to the legend that was the 6P (dual speakers)
I'm going to be in the better for a new phone soon and I'm thinking of getting a foldable, probably gonna be between the pixel and Samsung unless the government starts allowing Huawei and/or Xiaomi to cook