Google’s Gemini seems to be improving rapidly, to the point where Bloomberg’s Mark Gurman said Apple Intelligence is underwhelming compared to Gemini. And Google is determined to bring its AI to any app it can, with Gemini now recognizing and working with YouTube as well.
There are actually two really cool Gemini features that are seemingly rolling out simultaneously for the Gemini and Google app betas. One is the “ask about this screen” feature and the other is “ask about this video”. The former was shown off at Google I/O this year where the company also showed off Project Astra. “Ask about this video” is basically the same thing, but it works for videos on YouTube.
Both have their use cases, so let’s talk about them in a little more detail.
Ask Gemini about your screen
Image credit — Google
Gemini is smart enough to understand what’s happening on your screen, something Apple Intelligence is also claimed to be capable of. You don’t have to stick to that single phrase either. Which means you don’t have to specifically say, “Gemini, what’s on my screen?” Instead, there is a helpful button that prompts the AI to receive queries about what’s currently being shown.
As with all modern LLM (Large Language Model) AIs, you can converse with Gemini in a very natural way. Find yourself on a webpage with a very long article? Bring up Gemini and tell it to give you a summary. Have an image open and can’t make heads nor tails of it? Our AI friend can probably help.
The idea is that Gemini should always be at your fingertips, ready to assist in anything that might have you stumped.
Ask Gemini to summarize a YouTube video
Image credit — PhoneArena
This same feature, when being used in the YouTube app, takes on the slightest of changes. The button that read “Ask about this screen” now reads “Ask about this video” instead. There’s also a little YouTube icon to let you know that you’re about to ask Gemini something related to the video.
What’s hilarious is that Gemini uses the captions of a YouTube video to generate its responses. So if you don’t play the video, or even the preceding ad, you can still get Gemini to answer questions about the video.
I doubt this exploit is going to stay around for too long. Gemini will either start telling you to get done watching the ad or “helpfully” suggest subscribing to YouTube Premium. But hey, let’s enjoy it while it lasts.
Gemini in everything
Always listening… | Image credit — Google
As I mentioned above, Google is determined to bring Gemini to everything. I don’t have a problem with that myself but I’m glad most of the AI tools can be toggled off in case a user doesn’t want them. There’s AI in:
These are just Google’s services too. Many other platforms are also integrating their own AI into their apps. It seems pretty soon there won’t be a single device left that isn’t powered by AI. Naturally, Google doesn’t want to be left behind in this AI race.
Though AI has made it to places where it doesn’t seem all that useful (looking at you, countless emails about AI products) there’s no denying that lots of services will benefit from its inclusion. And with on-device AI alongside almost every service incorporating AI into it, Google seems to be setting itself up pretty well for the incoming age of AI.
Abdullah loves smartphones, Virtual Reality, and audio gear. Though he covers a wide range of news his favorite is always when he gets to talk about the newest VR venture or when Apple sets the industry ablaze with another phenomenal release.
Recommended Stories
Loading Comments...
COMMENT
All comments need to comply with our
Community Guidelines
Phonearena comments rules
A discussion is a place, where people can voice their opinion, no matter if it
is positive, neutral or negative. However, when posting, one must stay true to the topic, and not just share some
random thoughts, which are not directly related to the matter.
Things that are NOT allowed:
Off-topic talk - you must stick to the subject of discussion
Offensive, hate speech - if you want to say something, say it politely
Spam/Advertisements - these posts are deleted
Multiple accounts - one person can have only one account
Impersonations and offensive nicknames - these accounts get banned
Moderation is done by humans. We try to be as objective as possible and moderate with zero bias. If you think a
post should be moderated - please, report it.
Have a question about the rules or why you have been moderated/limited/banned? Please,
contact us.
FCC OKs Cingular\'s purchase of AT&T Wireless
Things that are NOT allowed: