Understanding Spanish without a course: with Samsung's new AI functions

Some of the AI functions on the Samsung Galaxy S24 have been developed by Samsung itself. Other functions run in collaboration with companies such as Google or Microsoft. While some applications run directly on the device, others require cloud access. However, these cloud functions can be deactivated. Lorenz Keller has already presented one of the Google functions, Circle To Search, in detail.

A selection of the AI functions will also appear on the Galaxy S23 series models, the Galaxy Z Fold 5 and Flip 5 and the Galaxy Tab S9. This can be seen, for example, in the comparison table of the individual Galaxy models on Samsung's website. The AI section there states "coming soon".

Rotate, move and remove objects in your photos

Samsung's image editing AI should make Photoshop a thing of the past. At least for simple, quick edits. Outstanding functions include moving objects and removing reflections. Hats off to Samsung for adding a watermark to the corner of each edited image. This makes it transparent which images the AI has been involved in.

For the object transformation, press the edit button on the desired image in the gallery and then the AI button. Now tap on the desired objects to move, resize or delete them. Then press "Create" and let the AI calculate the result.

The quality of the result depends on the images and objects selected. Sometimes the AI doesn't recognise what the objects are. So it artificially blurs the background and adds confusing objects. So I can't compensate for my lack of skateboarding skills. One successful example is a wooden spoon that I have made disappear from the pot. Only at second glance do I recognise the AI's shortcomings.

The background addition is handy if you have taken a picture that is a little too crooked. Then rotate it to the desired angle in edit mode and let Samsung's AI fill in the missing background at the corners. Well, here, too, it works well once and once Samsung's AI adds confusing things and makes blurred corners.

Let's see how the AI removes reflections. When taking photos through a window, the reflection in the pane sometimes disturbs the great view. If I swipe the picture I've taken upwards in the gallery, the app shows me the option to remove reflections alongside the picture information. This also works differently depending on the image.

The image editing AI is still in its infancy and should improve in the future. So far, the functions are definitely great ideas that deliver better or less good results depending on the template.

Very slowly please: Slow Motion

I'm excited about the AI-supported slow motion for videos. You should definitely record the template with a setting of 60 frames per second instead of the default 30. The AI inserts additional frames between the existing ones when editing the slow-motion video to achieve a smooth result. I actually think it works quite well, but I also see slightly blurred edges around the moving object - me. This problem doesn't apply to videos with a moving background, as this is blurred anyway.

[video:248516]]

Ordering tacos in Spanish: the language AI

You have three options for translating foreign languages on the Galaxy S24. A live translation during phone calls, an interpreter for conversations and the option to translate text messages directly afterwards.

Firstly, the live translation of phone calls. To do this, you download the required language packs directly to your Galaxy smartphone in the settings beforehand. There are 13 of them at launch: English, German, French, Italian, Spanish, Portuguese, Polish, Korean, Chinese (simplified), Japanese, Thai, Vietnamese and Hindi.

How exactly does it work? In the call settings, you determine your preferred language and interpreter voice (male or female) in advance. If you are on a call, you can now activate live translation at any time and select settings such as the required languages. Your contact will then be informed that a translation will now follow.

For saved contacts, you enter the preferred language in advance. The person you are talking to does not need a Samsung device for this, everything takes place locally with your language packs. Patience is important - the live translation takes a few seconds for each text block.

If you only want to listen to the translation without the original audio, you can adjust this in the settings. Here you can also choose to reply in writing - this minimises the risk of errors. The robot voice then reads out your text.

Even with clear pronunciation, Samsung's speech recognition still hears some things incorrectly and therefore does not translate everything correctly. I always understood it in context. According to Samsung, the AI is constantly learning.

The Interpreter app works in a similar way to the live translation. As with Google Translate, you have two input fields to which you assign the respective language. If I want to order from a Spanish waitress, I set Spanish for her and German for me.

For added convenience during the conversation, I can turn the input field in her direction. When the conversation starts, I press the record button. The app then automatically switches directly to the other side once it has translated the relevant part of the conversation. Both the automatic switch and the translation are not entirely reliable. In context, however, I understand what is meant.

Last but not least, Samsung's AI also translates written text messages. So far, this works with the following messaging services: Samsung, Google Chat, Kakao, Signal, WhatsApp, Line, Instagram DM and Tango. To translate, tap the AI button in the Samsung keyboard and then select the desired translation language from the drop-down menu. The translator is generally better in writing than in verbal conversations.

Functions for lazy readers and typists

Another function for text messages is style customisation. In your messaging apps, you can have suggestions for different tones displayed. For example, to sound more professional or to embellish something. The function is located directly in the Samsung keyboard above the AI button. You can also have your typed text checked for spelling and grammar. You simply accept the respective suggestions at the touch of a button. For the style of your text, you can choose between "Professional", "Casual", "#Social", "Polite" and "Add emojis".

I have to smile at the professional version in German, the wording is clichéd and exaggerated. In addition, Samsung interpreted a meeting into my setting - according to the motto #Could_have_been_an_email.

If you want to get an overview of a web article, for example Lorenz's comparison of the two chips in the new Samsung Galaxy S24, you can have everything summarised via the Samsung browser. You can choose between Standard and Detailed.

Then copy the summary into your notes if required. This includes the web link. This worked wonderfully for the article I selected; Samsung's AI filtered out the important information correctly. It is also possible to translate the website - nothing groundbreaking, but useful.

The third helper to save time can be found in Samsung's recorder app. You can have recorded conversations transcribed. Here again, the phone uses the local voice packages. The app recognises when several people are speaking and differentiates between them when transcribing.

Unfortunately, my attempt to transcribe the conversation from the song "Die da" by Fantastischen Vier doesn't work at all. The strong background beats probably interfered. My second attempt at an interview by Harald Schmid with Falco from 1994 delivers the same (in)accurate results as the interpreter.

If I then have the transcription summarised by Samsung's AI, amusing misunderstandings arise. So if you want a transcription of your own interview, you'll have to do a lot of editing. But at least you have a basis that will save you a lot of time.

Last but not least, here's something for your notes: You'll find three new AI-supported functions here. Automatically formatted texts, corrections and summaries. As an example, I've created a list of action films that I want to watch. I had Samsung format the raw text directly in the app. The AI even creates several formatting options for me to choose from. I then had the AI translate the text from English to German and format it too. Cool thing.

Artificial intelligence: good things take time

Samsung's AI still has its weaknesses and often seems to me like a gimmick with construction sites. However, I can see practical applications in everyday life, especially with the voice functions - provided that improvements are made here over time. I think it's important to make it clear at all times when artificial intelligence is intervening.

*How do you see this? Do you find some of the AI functions useful on your smartphone? Or are you rather suspicious of them?