We have been talking about the Pixel 9 series for some time now and finally, they were unveiled at the Made by Google event that concluded last night. To nobody’s surprise, AI was the highlight of the Pixel 9 segment getting the most attention and screen time. Well, what can I say? It is supposed to be the next big thing. Here’s your first look at all the AI features, powered by Gemini of course, that you get with different Pixel 9 phones.
Table of Contents
1. Screenshots App – Find Anything
Pixel 9 series comes with a new Screenshots app. However, a separate app makes less sense to me. They could have bundled it within Google Photos or Gallery app – a separate tab? Either way, it is here now and powered by AI.
Like that recipe? Take a screenshot. Found a useful tip? Take a screenshot. What about that receipt of an official trip? All your screenshots will be saved to this new Screenshots app, instead of the Gallery app leaving it clutter-free. Now screenshots have great recall value but finding the right one can be tough. Honestly, the thumbnails don’t really help, do they? And before you know it, the folder will be full of hundreds of screenshots.
This is where the Gemini AI feature might actually shine through. You can now search for things, text, items, etc. within these saved screenshots using text or voice commands. For example, McDonald’s receipt from last week or screenshot of that cool green coffee mug from Instagram you saved as a gift idea.
All the contents of the screenshots are searchable and on-device. What I like is the organization and note-taking feature to help add some context. Interestingly, the app remembers where you took the screenshot so you can go back to the source if you want to buy that mug.
2. Add Me – Never Miss Group Photos Again
Pixel introduced Best Take feature last year which created quite a buzz on the social media. Everyone wants to look good in the photos after all. But what if you can’t make the group photo because you are the one taking the shot? Pixel 9 series has a new trick up its sleeve called Add Me.
It’s pretty cool how Add Me works honestly. While taking a group photo, simply leave some space where you would imagine yourself to be standing for example. Once the shot is taken, ask someone else from the group to take a second image while you stand in that empty space. Pixel will then combine the two images to create one that has you standing with the entire group.
So how do you know where to stand so that the image is not ruined? To take the guesswork out of the picture (get it!), Pixel will show you an AR overlay so you can be guided to the exact spot where you are supposed to be. It’s a pretty neat trick.
No need to stretch your arms to take a group selfie anymore. They never come out the way we want them to anyways. And carrying selfie sticks just adds to the weight.
3. Pixel Studio
Pixel Studio is an AI-powered image generator app. Just type what you want and it will generate an image based on it. You may have heard or used the Dall-E 3, Meta AI in WhatsApp, or even Copilot. It works well and just as you would expect from an AI text-to-image generator app.
What I like is the ability to create stickers from generated images. You can also add images and stickers to the generated image to personalize it the way you want.
4. Weather Reports
A newly designed weather app was introduced too. Weather is personal and everyone has their favorite weather app. So why switch to Pixel Weather? The demo showed an AI-generated weather report that you can read.
Useful for those who don’t know how to read weather reports or don’t have time to decipher what all the numbers and graphs mean. Would be super useful if I can schedule this weather report in Google Routines so it is read to me first thing in the morning. We will test this and other AI features when we get our hands on the devices in-house.
5. Call Notes in Call Assist
A new feature part of the existing Call Asisst is Call Notes. As you may have guessed by the name, it will create an AI generated summary of the call you were just on. Google says the summary is private and secure and kept on-device.
I like how the AI-generated summary has an intro followed by short bullet points. Makes it easier to read and comprehend while faster to scan and find what you are looking for. Nice touch. Note that activating this will notify everyone on the call.
6. Made You Look
This Pixel AI is a feature exclusive to the Pixel Fold 2, officially named Pixel 9 Pro Fold because it has a front screen with a camera. Here is how it works. When enabled, a fun kid-friendly animated video will play on the outer screen to help the baby relax and maybe get him/her to smile or laugh. When that happens, click a photo with the back camera.
Again, a smart and thoughtful AI feature addition. I guess adults will no longer have to make those noises when trying to get their kids to look at the camera and smile. But then again, where is the fun in that. Babies do bring out the kid in all of us.
7. Magic Editor
Pixel phones already come with an AI feature called Magic Eraser that removes unwanted objects and people from frames. They can be annoying and ruin your otherwise perfect shot. But Google took things one step further with Magic Editor. Once you have taken a photo, you can use Magic Editor to edit the image using AI to recompose it. Few options like golden hour and sky were visible.
You can change the skyline, the ground, or pretty much anything in your surroundings. I am divided on this one though. On one hand, the techie me loves the AI features Google team has worked on but on the other hand, nothing I ever see will feel real again. Photography is an art after all.
8. Generative AI in Videography
Google’s Gemini AI can turn your 4K video recordings into 8K but we will see how it goes in real life later when we come out with a full review of the Pixel 9 series soon… after running some tests.
Other features include ability grab stills from videos at 33MP quality for thumbnails and social media profiles.
9. Gemini AI – At the Core
Gemini AI powers all the features that we have discussed so far. But Gemini is also a stand-alone app that you can summon to search for relevant data and information as and when you need it. Google says Gemini can understand what you mean and decipher your intent better than ever before live-demoed some examples that were cool.
Gemini assistant can go beyond understanding your words and understand your intent.
An example can be when you search for an email in your Gmail from Harry regarding that family dinner reservation. Gemini will also add the destination details on Google Maps and remind you when the time comes using the Calendar app.
That would be useful to many people in many different scenarios across so many apps! Another example of using Gemini AI working its way across apps can be writing an email reply (Gmail) based on input provided by my boss in Slack or minutes I took in Notes.
Google says all the data is secured in its cloud but also mentions on-device generative AI using Gemini Nano for sensitive and private data and use cases.
But Gemini is no longer restricted to text and images. It works with audio and video too. For example, if you are watching a food blogger’s video, Gemini can create a list of foods that he/she is eating, find recipes and add them for later, and maybe even take you to places where you can buy groceries for the same. However, it seems Gemini relies on video captions for this which YouTube can generate automatically so we are sorted.
All of this uses natural language processing. In simpler terms, you can have a conversation with Gemini Live like you are talking to your friend. You can choose from up to 10 voices during setup. but wait, what’s Gemini Live? Gemini Live is simply where you use AI to scan your surroundings to solve problems, find answers, or explore the world around you using camera lenses.
Well, that’s it from our side for now. Google has promised more features by way of Pixel Drops in the future. We will keep you updated on them when they arrive.
