Showcased at the WWDC 2024 event, the groundbreaking Apple Intelligence system boasts a multitude of AI features and experiences, which are truly meaningful in many cases. The best part is that Apple will process most of the AI tasks locally, on the device. The Cupertino tech giant won’t roll out all the Apple Intelligence features in one go. Rather, it has offered the first set of AI features with iOS 18.1, iPadOS 18.1, and macOS Sequoia 15.1, with more capabilities arriving with future updates. With that said, here are all the Apple Intelligence features for iPhone, iPad, and Mac.
1. Writing Tools
Writing Tools is an AI feature, powered by Apple Intelligence, and you can use this feature in any text field, on any app. This Apple Intelligence feature lets you rewrite texts, proofread paragraphs, change the tone, and more. You can also add your prompt to rewrite the text according to your preference or select a text to get a summary out of it. That’s not all. You can do a lot more with Writing Tools, like pull out key points from a long paragraph, make a list, or quickly turn data & numbers into a table. Writing Tools are available across iOS, iPadOS, and macOS. So, you can access these tools in Messages, Notes, Mail, and third-party apps as well.
2. Genmoji
Genmoji is an interesting feature that lets you create custom emojis for any occasion using Apple Intelligence. You can create unique Genmojis on an iPhone by bringing up the AI prompt & keyboard to type a simple description like “cat playing the guitar”. As you provide the description, your iPhone will show you a new Genmoji along with more options to choose from. You can also use photos to create a Genmoji of friends and family. So, you can now turn your Mom into a superhero using Genmoji on your Apple Devices.
3. New AI-Powered Siri
Of all the new AI features coming to Apple devices, the most exciting is the more capable and more personal new Siri which is deeply integrated within the system. It has a new design and shows a glowing light around the corners when activated. The new Siri is pretty fast and can perform a wide range of on-device tasks. You can now ask questions about your iPhone, in case you can’t find a setting or a feature. It also has “on-screen awareness” and can see your screen to understand context and perform suitable actions.
Not only that, Apple Intelligence creates an on-device semantic index that stores all the relevant information. Whenever there is a user intent for an action, the relevant information is used to further process the user request. For example, if you ask the new Siri to check your flight schedule, it can automatically pull all your flight details from the Mail app and show you the current status. It can also set a schedule based on that information. It can perform many such on-device tasks which seems to be a gamechanger.
4. ChatGPT Integration
Apple has partnered with OpenAI to integrate ChatGPT across the system. With ChatGPT Integration, Apple’s AI system can handle on-device intelligence as well as complex queries that are beyond the capabilities of Siri. Apple has integrated ChatGPT into iOS, iPadOS, and macOS, allowing users to access it via Siri, Writing Tools, and other first-party apps & features.
When a user asks a complicated question that Siri can’t handle, it will by default seek the user’s permission to hand off that query to ChatGPT. Then, the response will be relayed through Siri. Besides, ChatGPT can also help compose text in Writing Tools. You can simply describe what you want, and ChatGPT will create it for you.
It’s worth knowing that ChatGPT Integration is separate from Apple Intelligence as your queries go to OpenAI’s cloud servers. However, Apple mentions that user queries won’t be logged by OpenAI.
5. Clean Up Tool
The new AI-powered Clean Up tool is Apple’s equivalent to Google’s Magic Eraser. The Clean Up tool uses advanced detection and multiple machine learning models to identify and remove distractions in an image without affecting the overall picture. When you remove an element from the image, the Clean Up tool uses AI to generate a complementing background. The Clean Up tool appears as a new option (eraser-style icon in the bottom toolbar) when you edit an image in the Photos app. It works with all images in the Photos app, including older images and pictures captured by a DSLR camera or another phone.
6. Memory Movies & More in Photos App
With Apple Intelligence, it’s easier to search for photos and videos in the Photos app. Simply provide a description of the photo you’re looking for like ‘Katie wearing a green blazer’, and the Photos app will quickly pull out matching images for you. Also, you can now easily search for specific moments within a video clip. That’s not all. The Photos app can create a Memory Movie of the story you wish to see. When you enter a description, Apple Intelligence finds the best photos and videos that match. It then crafts a storyline, chooses a relevant song, and arranges your photos into a beautiful memory movie.
7. Image Playground
With the dedicated Image Playground app, you can generate cartoon-style AI images on your Apple device and it’s powered by Apple Intelligence. The feature is also available in many first-party apps like Notes and Messages. You just have to add your description and choose a style such as animation, illustration, or sketch, and Image Playground will generate an image for you. Besides providing descriptions, you can even use pictures of your contacts and friends to inspire images.
8. Image Wand
Coming later this year, Image Want is an Image Playground-based feature that can transform your rough sketch into a related image in the Notes app. On your iPad, you can use Apple Pencil to draw a circle around your image, and Image Wand will analyze the content around it to whip a nice visual that complements your notes. When you circle an empty space, Image Wand will use the surrounding context to generate a complementing picture.
9. Smart Replies in Mail and Messages
In the Mail app, Apple Intelligence puts time-sensitive messages on top of your inbox so that you don’t miss any deadlines. You can also read summaries of long emails in just one tap. If you want to quickly reply to an email or message, you can use Smart Reply to send a tailor-made response. Also, Multiple Messages or Mail notifications are summarized on your Lock Screen so you can see all the notifications without opening the app. Apple also plans to add a feature to the Mail app that will automatically sort your incoming messages into categories for better organization of things like newsletters and purchase emails.
10. Priority Notifications
Apple Intelligence can also prioritize notifications in iOS 18. It intelligently puts your important notifications on top of the stack and summarises them so you can pay attention at a glance. And if a message is important, it shows a ‘maybe important’ label on top of the notification stack, even when Focus mode is on.
11. Summarize Web Pages in Safari
Apple Intelligence also brings a super-useful feature to Safari that lets you summarize web pages. When you’re in reader mode, you’ll see a brand-new Summarize option to get the AI-generated summary of the webpage. This feature quickly summarizes text and is quite helpful in cases where you don’t want to scroll through large blocks of text.
12. Reduce Interruptions Focus Mode
Apple’s AI system introduces an all-new Focus Mode named ‘Reduce Interruptions’ that uses Apple Intelligence to surface only the important notifications while filtering out everything else. When you set up and use Reduce Interruptions Focus Mode, you’ll only see notifications that might need immediate attention. For instance, you’ll see notifications about an early pickup from playschool or your dental visit appointment confirmation. This is a useful Apple Intelligence feature that lets you stay on top of your important notifications without being carried away by unwanted distractions.
13. Call Recording Transcription
Believe it or not, Apple has brought call recording to iPhones with iOS 18. So, you can finally record phone calls on your iPhone, without going for any workaround or a paid app. When you tap the Record button, it will relay an audio message that call recording has been enabled. The best part is that you also get the transcribe feature for recorded calls which saves call summaries so that you can quickly find important information later on. You can also transcribe audio files in the Notes app.
14. Visual Intelligence
Visual Intelligence is a super-cool iPhone 16 exclusive feature that lets you use the Camera Control button and on-device intelligence to discover anything that your camera points to. Imagine Apple’s version of Google Lens. For instance, when you point the camera to a restaurant, your iPhone will bring details like open hours, ratings, menu, and more.
So these are the new Apple Intelligence features for iPhone, iPad, and Mac. If you are looking for a list of devices that support Apple Intelligence, go through our list. Bear in mind that the recently released iOS 18.1 update brings Apple Intelligence features and experiences only to the United States. In December, Apple Plans to bring its AI system to the UK, Australia, Canada, South Africa, and New Zealand, via the iOS 18.2 update. India, Singapore, Italy, and other countries will get the Apple Intelligence features in 2025.
With iOS 18.1, Apple is rolling out the first serving of its AI features, including Writing Tools, Clean Up tool, new Siri UI, and more. Some of the most impressive features like Genmoji, ChatGPT integration, Image Playground, Image Wand, and more will arrive at a later date with future iOS 18.2, iOS 18.3, and iOS 18.4 updates.
