Apple's New Clean Up Feature Uses AI to Remove Objects from Photos in iOS 18.1 and macOS 15.1 Sequoia

Apple has rolled out its latest developer betas for iOS 18.1, iPadOS 18.1, and macOS 15.1 Sequoia, unveiling a range of new Apple Intelligence features. Among these, a standout is the "Clean Up" feature, a sophisticated tool designed to allow users to seamlessly remove unwanted objects from photos. This innovation leverages AI to fill in the background after an object is removed, maintaining the integrity of the original image.

Clean Up: Removing Objects with a Single Tap

The Clean Up feature is designed to be both powerful and user-friendly. It enables users to identify and remove objects from photos with just one tap, thanks to its smart detection capability. This AI-driven system not only removes the object but also understands and accounts for elements like shadows and reflections, ensuring a natural and seamless background restoration. For users who prefer more control, the feature also allows manual selection by circling or brushing over objects that need to be deleted.

Competing with Google's Magic Eraser

Apple’s Clean Up feature comes on the heels of a similar tool from Google, known as Magic Eraser. Earlier this year, Google made Magic Eraser available for free to all Google Photos users, setting a high bar for AI-driven photo editing tools. With Clean Up, Apple aims to offer a comparable if not superior experience, integrating it directly into its ecosystem with the new Apple Intelligence suite.

Expanding Apple Intelligence

The introduction of Clean Up is part of Apple's broader strategy to enhance its AI capabilities across its devices. Apple Intelligence, first introduced in the iOS 18.1 developer beta earlier this year, includes features designed to make users' lives easier through AI. These features range from writing tools and natural language search to transcription services for calls and voice recordings. The system also includes advanced notification summaries and smart replies in Mail, all powered by Apple's AI technologies.

Availability and Regional Limitations

While the Apple Intelligence features represent a significant leap in functionality, they are currently only available to users in English, with their region set to the U.S. This limitation might disappoint some international users, but it also indicates Apple's cautious approach to rolling out new AI-powered functionalities.

Conclusion

Apple's latest developer betas for iOS 18.1, iPadOS 18.1, and macOS 15.1 Sequoia mark a significant step forward in the integration of AI into everyday tasks. The new Clean Up feature highlights Apple's commitment to enhancing user experience by making complex photo editing tasks as simple as a tap. As Apple continues to expand its AI capabilities, users can expect more innovative features that blend cutting-edge technology with user-friendly design.