Samsung and Google Cloud bring generative AI to Galaxy S24 smartphones

Samsung has partnered with Google Cloud to integrate generative AI into Samsung Galaxy S24 Series smartphones.

The companies unveiled a multi-year partnership to bring advanced generative AI to Samsung smartphone users globally. The partnership kicks off with the launch of the Samsung Galaxy S24 series, introduced at the Galaxy Unpacked event in San Jose, California, today.

Samsung becomes the inaugural Google Cloud partner to integrate Gemini Pro and Imagen 2 on Vertex AI via the cloud to its smartphone devices.

Janghyun Yoon, corporate executive vice president at Samsung Electronics, said in a statement, “Google and Samsung have long shared deeply held values around the importance of making technology more helpful and accessible for everyone. We’re thrilled that the Galaxy S24 series is the first smartphone equipped with Gemini Pro and Imagen 2 on Vertex AI.”

Gemini Pro, a multimodal AI system, allows users to seamlessly operate across various types of information, including text, code, images, and video. Users can leverage summarization features across Samsung-native applications, including Notes, Voice Recorder, and Keyboard, enhancing the overall user experience. Gemini Pro on Vertex AI ensures critical Google Cloud features, such as security, safety, privacy, and data compliance.

Samsung Galaxy S24 series users will also benefit from Imagen 2, Google’s text-to-image diffusion technology. Imagen 2 on Vertex AI enables safe and intuitive photo-editing capabilities through features like Generative Edit 2 in the S24’s Gallery application.

As part of this collaboration, Samsung is among the first to test Gemini Ultra, Google’s largest model for highly complex tasks. Additionally, the S24 series will employ Gemini Nano, an on-device Large Language Model (LLM) delivered as part of the Android 14 operating system, enhancing efficiency for on-device tasks.

Thomas Kurian, CEO of Google Cloud, said in a statement, “With Gemini, Samsung’s developers can leverage Google Cloud’s world-class infrastructure, cutting-edge performance, and flexibility to deliver safe, reliable, and engaging generative AI powered applications on Samsung smartphone devices.”

This partnership represents a strategic move to enhance Samsung’s technological offerings, providing users with innovative features powered by Google Cloud’s advanced generative AI technologies.

Availability of the service may vary by country, region, or market. Accuracy of results are not guaranteed.

The Samsung Galaxy S24 Series

AI was one of the main features that Samsung touted as it unveiled the Galaxy S24 Ultra, Galaxy S24+ and Galaxy S24 smartphones today.

Samsung said the AI amplifies nearly every experience on the Galaxy S24 series, from enabling barrier-free communication with intelligent text and call translations, to maximizing creative freedom with Galaxy’s ProVisual Engine, to setting a new standard for search that will change how Galaxy users discover the world around them.

“The Galaxy S24 series transforms our connection with the world and ignites the next decade of mobile
innovation,” said TM Roh, president and head of mobile experience business at Samsung Electronics, in a statement. “Galaxy AI is built on our innovation heritage and deep understanding of how people use their phones. We’re excited to see how our users around the world empower their everyday lives with Galaxy AI to open up new possibilities.”

Samsung said Galaxy AI introduces meaningful intelligence aimed at enhancing every part of life, especially the phone’s most fundamental role: communication. You can use Live Translate2, a two-way, real-time voice and text translator of phone calls within the native app. No third-party apps are required, and on-device AI keeps conversations private.

With Interpreter, live conversations can be instantly translated on a split-screen view so people standing
opposite each other can read a text transcription of what the other person has said. It even works without
cellular data or Wi-Fi.

For messages and other apps, Chat Assist can help perfect conversational tones to ensure communication sounds as it was intended: like a polite message to a coworker or a short and catchy phrase for a social media caption. AI built into Samsung Keyboard can also translate messages in real-time in 13 languages. In the car, Android Auto will automatically summarize incoming messages and suggest relevant replies and actions via voice commands, like sending someone your ETA, so you can stay connected while staying focused on the road.

Organization also gets a big boost with Note Assist in Samsung Notes, featuring AI-generated
summaries, template creation that streamlines notes with pre-made formats, and cover creation to make notes easy to spot with a brief preview. For voice recordings, even when there are multiple speakers,
Transcript Assist uses AI and Speech-to-Text technology to transcribe, summarize and translate
recordings.

With a long press on the home button, users can circle, highlight, scribble on, or tap anything on Galaxy S24’s screen to see helpful, high-quality search results. Seeing a beautiful landmark in the background of a friend’s social media post or a surprising fun fact on YouTube Shorts can quickly become an accurate search to learn more – without having to leave that app.

And depending on a user‘s location, for certain searches, generative AI-powered overviews can provide helpful information and context pulled together from across the web, and users can ask more complex and nuanced questions.

Galaxy S24 series’s ProVisual Engine10 is a comprehensive suite of AI-powered tools that transform
image capturing abilities and maximize creative freedom every step of the way, from setting up a shot all
the way to sharing it on social. Gone are shaky, pixelated images taken from far away. Galaxy S24 Ultra’s
Quad Tele System, with new five times optical zoom lens, works with the 50MP sensor to enable optical-quality performance at zoom levels from 2x, 3x, 5x to 10×11 magnification thanks to Adaptive Pixel Sensor. Images also show crystal clear results at 100 times with enhanced digital zoom.

To give users even more creative control and freedom, Generative Edit can fill in parts of an image background with generative AI. When a picture is crooked, AI will fill in the borders. When a person or object needs to be slightly moved to be in the perfect position, AI lets users adjust the position of the subject and generates a perfectly blended background in its original spot. Anytime Galaxy S24 deploys generative AI to amplify an image, a watermark will appear on the image and in metadata. And if an action-packed video needs to be slowed down, new Instant Slow-mo can generate additional frames based on movements to smoothly slow down action-packed moments for a more detailed look.

Qualcomm’s Snapdragon 8 Gen 3 Mobile Platform

The Galaxy S24 Ultra is equipped with Snapdragon 8 Gen 3 Mobile Platform for Galaxy. Optimized especially for Galaxy users, this chipset delivers remarkable NPU improvement for efficient AI processing. In all three Galaxy S24 models, 1-120 Hz adaptive refresh rates also improve performance efficiency.

Galaxy S24 users have full controllability over how much they allow their data to enhance AI
experiences, through Advanced Intelligence settings which can disable online processing of data for AI
features.

The Galaxy S24 Plus and S24 will also use the Qualcomm chip set in select regions.

“We’re proud to continue working alongside Samsung to lead this new era for the mobile industry and provide consumers with extraordinary premium experiences,” said Chris Patrick, senior vice president and general manager of mobile handset at Qualcomm, in a statement. “Snapdragon 8 Gen 3 for Galaxy instills its advanced AI capabilities in the Galaxy S24 series, to enable new experiences with AI features to empower users’ everyday life. It also fuels advanced professional-quality camera, gaming experiences and ultra-fast connectivity including Wi-Fi 7, plus offers one of the most reliable authentication solutions available with our Qualcomm 3D Sonic Gen 2 technology.”

Inkang Song, vice president and head of technology strategy team at Samsung Mobile, said that the alliance with Qualcomm spans more than two decades.

“They are at the forefront of the mobile industry, and now of on-device intelligence – the Snapdragon 8 Gen 3 for Galaxy sets the bar for premium mobile and Gen AI experiences. With the flagship Galaxy S24 series, Qualcomm and Samsung will provide consumers with the most premium and advanced mobile experiences to date, with Galaxy AI,” Song said.

Availability and offers

Pre-orders begin today, January 17, 2024, through January 30,2024. Customers who pre-order a Galaxy. The new Galaxy S24 series will be available starting on January 31, 2024 on Samsung.com, at Samsung
Experience Stores, and at major carriers and retailers.

• Galaxy S24 Ultra will start at $1,3009 with storage capacity options of 256GB, 512GB, and 1TB.
• Galaxy S24+ will start at $1,000 with 256GB and 512GB storage options.
• Galaxy S24 will start at $800 with 128GB and 256GB storage options.