WWDC wouldn't be complete without an announcement about what's being improved on Apple Intelligence. Apple previously confirmed that Apple Intelligence would use the Gemini base model as a foundation. At WWDC, Craig Federighi emphasized that Apple Intelligence isn't just a direct copy-paste of Gemini into the Apple ecosystem but instead uses data that's retrained to meet Apple's needs.
As written earlier this morning, the first feature that was given the spotlight was Siri AI. Finally, Siri uses Apple Intelligence to offer a variety of features promised at WWDC last year. It's now smarter about answering questions, understanding context, having threaded conversations, and more. Siri AI is also now its own app, available on iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27 devices. There's no support for tvOS for reasons that will be touched on in the final paragraph.
The most interesting demo is in the Photos app with the new Spatial Reframing, Extend Tool, and Clean Up features. Spatial Reframing uses spatial information to change the angle of the original photo taken. The camera can be repositioned and the object will also change to produce a new Apple Intelligence-generated image. A very useful feature if the photo taken by someone does not match what you want.
Extend Tool enlarges the image from the original frame. Again, it generates a larger space in the image, perhaps because the camera is too close to the subject. Clean Up removes elements in the image more accurately. Last year, a video went viral in Photos that Clean Up could not generate hands and faces behind a deleted phone.
For those who like the Image Playground feature, the generated image is now more realistic or in a certain style. It can then be used as a chat background image, Contact Posters and used as a phone screen wallpaper. Users can generate images according to the screen ratio they want to use.
Image Playground
Another unique feature not found on other devices is Call Context. Let's say you call an airline customer service center. Apple Intelligence understands the context and will display relevant information such as flight number, travel date, and reservation number on the screen. No more having to open email in the background and then switching between two apps to find the information you need.
Call Context
Safari is also now smarter at automatically organizing tabs by context, providing notifications of price drops or new stock, and automatically changing passwords if they leak to the web arena.
The new Apple Intelligence can be used by devices with iOS 27, iPadOS 27, macOS 27, watchOS 27, and visionOS 27. The Image Playground image generation feature has a daily usage limit.
iPhone 15 Pro and 15 Pro Max
iPhone 16 & up,
iPad mini (A17 Pro), iPad with M1 chip and up
MacBook Neo, Mac with M1 and up
Vision Pro
Apple Watch Series 10, Ultra 2, SE 3 (with compatible iPhone)
But to use the most powerful Apple Intelligence model on a device, you need to have
iPhone Air
iPhone 17 Pro
iPad with M4 and up (and 12GB RAM)
Mac with M3 and up (and 12GB RAM)
