1

Google says running AI locally on phones requires tons of RAM | TechSpot

 1 month ago
source link: https://www.techspot.com/news/102450-google-running-gemini-ai-smartphones-require-gobs-ram.html
Go to the source link to view the article. You can view the picture content, updated content and better typesetting reading experience. If the link is broken, please click the button below to view the snapshot at that time.

Google says running AI locally on phones requires tons of RAM

Gemini Nano is coming to Pixel 8, but only as a developer option

By Shawn Knight Today 11:04 AM 8 comments
Google says running AI locally on phones requires tons of RAM
Serving tech enthusiasts for over 25 years. TechSpot means tech analysis and advice you can trust.

In a nutshell: Google's Gemini AI model landed on select mobile devices earlier this year via Android app, but some were surprised to learn that one of the company's latest flagship smartphones didn't make the list. During Mobile World Congress, it was revealed that Gemini Nano couldn't run on Google's Pixel 8 due to unspecified hardware limitations. Now, we've got a better idea of what was holding the phone back from on-device AI compatibility.

On a recent episode of the Made by Google podcast, VP of devices and services software, Seang Chau, said the Pixel 8 Pro with 12 GB of RAM was the perfect platform to load Gemini Nano onto and see what was possible. The entry-level Pixel 8, however, ships with 4 GB less memory, and it seems Google didn't want to "degrade the experience" by forcing the AI model to run on just 8 GB.

Google has since had a change of heart – well, sort of. In a recent announcement on the Pixel Phone Help site, the tech titan said it will be rolling out Gemini Nano to Pixel 8 users as a developer option in the next software drop. That's good news for devs that know how to enable it, but mostly a nothing burger for the average Pixel 8 user – at least, for now.

Jumping back to Chau's podcast appearance, the Googler explained that the company wants some of its AI-enabled features, like smart reply, to be "RAM resident." This means they "permanently" occupy a chuck of memory, which will allow them to be ready to go at a moment's notice.

It's worth mentioning that Google told Ars Technica that neither the Pixel 8 nor the Pixel 8 Pro are keeping Gemini in memory currently, and that you have to turn on a the developer flag to do so.

Armed with this new information, some will no doubt question whether or not they want Gemini Nano running on their phone at all. An unrestricted install will result in "permanently" losing a chunk of system memory, which could slow down the performance of other apps and services on your smartphone. Is that trade-off going to be worth it?


About Joyk


Aggregate valuable and interesting links.
Joyk means Joy of geeK