Home
News
You are here

Galaxy AI: Everything you need to know about Samsung's AI features

By Tsveta Ermenkova

Published: Sep 18, 2024, 7:54 AM

1comment

Samsung

You can't miss seeing Galaxy AI plastered all over Galaxy S24 ads. Samsung's really pushing Galaxy AI as a game-changer, promising it will revolutionize how we interact with our phones. It sounds pretty exciting, but what exactly is Galaxy AI, and is it worth upgrading your phone for?

Galaxy AI is built to refine existing features, bring in new tools, and generally boost device performance using the latest AI technology.

With Galaxy AI integrated, users can expect a range of new features and upgraded functions, so let’s explore the enhancements that elevate creativity and everyday use on Galaxy devices.

What is Galaxy AI?

Image credit – Samsung

Galaxy AI is a new system from Samsung that integrates artificial intelligence features across the Galaxy devices. It combines on-device processing with cloud-based AI to offer a variety of features designed to make your phone use smoother, more creative, and more efficient by automating tasks and offering helpful suggestions.

While Galaxy AI itself is not a Large Language Model (LLM), it uses LLMs for some of its features. Think of Galaxy AI as a toolbox and LLMs are the powerful tools within that box. Samsung partnered with Google Cloud to leverage its Gemini LLMs (including Gemini Nano, Gemini Pro and Gemini Ultra) to run specific functions on the Galaxy devices.

Similar to Google Gemini, OpenAI's ChatGPT, Meta AI, and other AI models, Galaxy AI can also dish out helpful responses to text prompts. With Galaxy AI, you can have it whip up messages for you, swiftly search images, translate foreign languages, and more.

Galaxy AI features

Image credit – Samsung

While some folks use their smartphones for work, creative ventures, or immersive gaming sessions, most of us rely on them for basic, day-to-day tasks. Luckily, Galaxy AI is all about enhancing these everyday experiences, rolling out a variety of new features geared toward making life easier.

Galaxy AI everyday usability

Live Translate

While Translation results can be impressive, it's important to note that the quality may vary with each use. | Image credit – Samsung

The Live Translate feature offers real-time audio and text translations during calls. Basically, the AI hears what the speaker is saying and after a short time, translates that into a language you can understand. Plus, since it operates on-device, your conversations remain completely private without needing an internet connection.

Samsung recently added 3 new languages and 3 new dialects to the 13 languages supported from the get-go and the tech giant might introduce more with time, especially if Live Translate's popularity rises.

How to use Live Translate? Well, you will first need to enable the feature by:

Open Settings on your Galaxy phone.
Navigate to Advanced features
Choose Advanced intelligence
Tap Phone (or access it from the Phone app's settings menu under Live Translate).
Enable the toggle for Live Translate.
Download any necessary language packs.

Then you need to initiate Live Translate during a call by:

Make or receive a call.
Tap the Call Assist button (three dots) during the call.
Select Live Translate.
The language settings you configured earlier will be used automatically. You can adjust them if needed.
Speak or listen during the call and Live Translate will translate in real time.

Interpreter

Check out how the Interpreter works. | Image credit – Samsung

This feature enables real-time translations during face-to-face conversations, displayed in a split-screen format for easy understanding. Both sides receive a transcription of what the other person is saying in a language they can understand.

To use Interpreter you need to follow some simple steps:

Open the Quick setting panel.
Select Interpreter.
Tap the language by the bottom microphone icon to select the language you will use
Tap the language by the top microphone icon to select the language the other speaker will use.
Tap the Change view mode icon to flip the top half of the screen to face the other speaker.
Tap the Microphone icon facing you and speak.

Chat Assist

You can translate any message you receive. | Image credit – Samsung

Chat Assist is a suite of features within Galaxy AI designed to enhance your text messaging experience. It utilizes a combination of on-device processing and cloud-based AI to offer three main functionalities:

Spelling and grammar check: This feature acts as a proofreader, identifying and suggesting corrections for any typos or grammatical errors in your message before you send it.
Writing style suggestions: Feeling unsure about the right tone for your message? Chat Assist can analyze your draft and suggest alternative phrasings in different writing styles. For example, it can make your message more formal for a work colleague or add emojis for a casual conversation with friends.
Real-time translation: This is perhaps the most impressive feature. Chat Assist allows you to translate messages in real time as you type or receive them.

Here's a quick breakdown of how to use Chat Assist:

Open the Messages app on your Galaxy phone.
Compose a new message or open an existing conversation.
As you type, Chat Assist will automatically check your spelling and grammar. It might underline any errors and suggest corrections.

To utilize writing style suggestions, tap the lightbulb icon that appears next to the text box. Chat Assist will offer alternative phrasings with different tones.
For real-time translation, tap the three vertical dots menu and select Translate. Choose the language you want to translate to and from.

Note Assist

Organize your messy notes with ease. | Image credit – Samsung

Note Asist helps streamline note-taking by creating summaries, providing templates, and even generating cover art within the Samsung Notes app. Here's how to access and use Note Assist:

Open the Samsung Notes app on your Galaxy device.
Create a new note or open an existing one.
Tap the Galaxy AI icon (three dots with stars) above the keyboard.
You'll see various options, including Auto format, Summarize, Correct spelling, and Translate.
Select the feature you want to use and follow the on-screen prompts.

Transcript Assist

Access the Transcribe Assist feature directly within the Voice Recorder app. | Image credit – Samsung

This feature makes handling voice recordings a breeze by transcribing, summarizing, and translating them as needed. While we’ve seen this on Google’s Pixel phones before, it’s exciting to see it becoming more widespread. To use it, you first need to:

Record your audio: Open the Voice Recorder app on your Galaxy phone and start a recording of the speech you want to transcribe.
Access Transcript Assist: Once you've finished recording, tap on the recording within the Voice Recorder app. There should be a "Transcribe" option available.

Circle to Search

You can discover your future dog's breed with Circle to Search. | Image credit – Samsung

Last but definitely not least is Circle to Search. This feature lets users search for anything on their screen with a simple circle, tap, highlight, or scribble on an image or word. It's worth mentioning that Circle to Search is not a Galaxy-exclusive feature.

It is also available on other Android phones, such as Pixel 8 and Pixel 8 Pro and the latest Pixel 9 series, and it works the same way as it works on Galaxy phones. To use Circle to Search you simply have to:

Tap and hold the home button.
Use your finger or an S-pen to circle or tap the object of interest.
Once your finger or S-pen is removed from the phone's screen, the web search will begin.

Galaxy AI use for creativity

Say goodbye to reflections. | Image credit – Samsung

AI advancements in the creative world have been super impressive lately. From generating images to editing videos, these tools have become a big deal, even sparking some controversy along the way.

Samsung gets that a lot of this editing happens on smartphones and probably that is why it is using the Galaxy AI to make the whole creative process way better. Curious about the effectiveness of AI photo editing tools? Test your skills by guessing which photos have been edited and which ones haven't.

Now, let's see some of the features that can help you kick your on-device creativity up a notch:

Edit Suggestion: Basically, AI will be able to scan your shot and suggest ways to improve it automatically.
Generative Edits: Expands images by filling in the background and borders when necessary.
Instant Slow-mo: Adds extra frames to a video to create a high-quality slow-motion effect.

But that’s not all – thanks to AI, you can now capture photos of objects so far away that you’d normally need professional gear to get the shot.

Galaxy Zoom AI

If digital zoom falls short, AI Zoom steps in to bridge the gap. The AI algorithms enhance digital zoom by cutting down on noise, sharpening details, and boosting overall image clarity when shooting distant subjects.

Video credit – Samsung

So, in short, Galaxy AI Zoom takes your smartphone photography to the next level, letting you capture stunning, clear images from afar with impressive detail and sharpness. Plus, Samsung promises that any images made or edited by AI will come with a watermark and metadata showing where they came from.

How to use Galaxy AI on your Galaxy phone

Some Galaxy AI features require an internet connection, while others run directly on the device. Generally, Galaxy AI operates with minimal effort on your part. Photos automatically get boosted with generative AI enhancements for 2x and 10x zoom levels and improved low-light shots.

Other handy features are just a tap away. For example, Edit Suggestion provides quick fixes for common photo issues. With Generative Edit, you can tap or draw around a subject in a photo to either remove it or move it to a different spot.

To search for an image, long-press the home button and tap, circle, or scribble over anything on your screen. If you spot a Galaxy AI button near the bottom of the screen, tap it to access special features like creating custom wallpapers, reformatting notes, and summarizing web pages.

If you want to tweak the options or need a refresher, you can find a list of your device’s AI features in the Settings menu:

Go to Settings
Tap Galaxy AI
Choose the AI feature you want to learn about
Select your preferred options

For more details, you can again open Settings and swipe to Tips and User Guide.

Which phones have Galaxy AI?

The latest Galaxy S24 series. | Image credit – Samsung

Galaxy AI is currently accessible on a wide variety of Samsung phones, including:

Galaxy S24 series (including S24, S24+, S24 Ultra)
Galaxy S23 series (including S23, S23+, S23 Ultra, S23 FE)
Galaxy S22 series
Galaxy S21 series
Galaxy Z Fold 6 and Z Flip 6
Galaxy Z Fold 5 and Z Flip 5
Galaxy Z Fold 4 and Z Flip 4
Galaxy Z Fold 3 and Z Flip 3

Interestingly, some AI features, like Circle to Search, are also available on the Galaxy A35 5G and Galaxy A54 5G. However, Drawing Assist is exclusive to the Galaxy Z Fold 6 and Z Flip 6, and isn’t offered on any other models.

Which tablets have Galaxy AI?

The Galaxy Tab S series is the main line of tablets that includes Galaxy AI. Specifically, the following models have access to these AI capabilities:

Galaxy Tab S9 series (including S9, S9+, S9 Ultra)
Galaxy Tab S8 series

The AI features are not available on the Tab S9 FE, A series tablets, or any other models.

Are Galaxy AI features free?

Yep, for now, all Galaxy AI features come at no cost, as long as you've got a compatible device to use them. However, there's a little disclaimer on the Samsung Galaxy S24 page that mentions:

Galaxy AI features will be available for free until the end of 2025 on supported Samsung Galaxy devices. Different terms might apply for AI features provided by third parties.

The Korean tech giant has not revealed specific details on pricing or which features might be affected. It might introduce a subscription fee or other payment model to access Galaxy AI features after December 2025.

So, while you might have to shell out for these new features down the road, for now, you can enjoy all the text recommendations and editing tips without spending a dime.

Galaxy AI security concerns

Image credit – Samsung

With any new tech, like the Galaxy AI, people naturally have questions about security. They want to know how much data this system is gathering, what it's doing with that data, and whether they can opt out of data collection altogether.

The upside of having AI systems like Galaxy AI directly on your smartphone is that they are not always connected to the internet or any external sources. This means your data is more secure. Samsung says that these devices are equipped with end-to-end secure hardware and real-time threat detection and collaborative protection.

Plus, if you are not keen on all this AI stuff, you can simply toggle off these features in the Advanced Intelligence settings and stick to your plain old AI-less smartphone experience.

View Full Bio

Tsveta, a passionate technology enthusiast and accomplished playwright, combines her love for mobile technologies and writing to explore and reveal the transformative power of tech. From being an early follower of PhoneArena to relying exclusively on her smartphone for photography, she embraces the immense capabilities of compact devices in our daily lives. With a Journalism degree and an explorative spirit, Tsveta not only provides expert insights into the world of gadgets and smartphones but also shares a unique perspective shaped by her diverse interests in travel, culture, and visual storytelling.