Augmented Reality
Apple has the world’s largest augmented reality platform with over 1 billion AR-enabled devices powered by ARKit, a framework that allows developers to easily create AR experiences, and RealityKit, the rendering, animation, audio, and physics engine built from the ground up for AR.RealityKit 2 introduces Object Capture, a simple and powerful API on macOS Monterey that enables developers — like Wayfair, Etsy, and more — to create high-quality, photo-realistic 3D models of real-world objects in minutes by taking photos shot on iPhone, iPad, or DSLR and transforming them into 3D models optimized for AR. These models can be viewed in AR Quick Look or added to AR scenes in Reality Composer or Xcode, making it easier than ever to build amazing AR apps. Developers like Maxon and Unity are using Object Capture to unlock entirely new ways of creating 3D content within some of the leading 3D content creation apps, such as Cinema 4D and Unity MARS.With new APIs in RealityKit 2, developers can also create more realistic and complex AR experiences with greater visual, audio, and animation control, including custom render passes and dynamic shaders.
Object Capture makes it easier for developers to create high-quality and immersive AR content in just minutes.
Graphics and Games
New APIs and tools in iOS, iPadOS, and macOS will help game developers create the next generation of games and deliver all-new experiences to their users. A new Metal texture compression tool supports all of the latest formats, as well as optimized formats for Apple silicon, making it easier for developers to bring high-end games to all of Apple’s platforms. Additionally, a new Virtual Game Controller on iPhone and iPad provides an easy method to optimize games that build in Game Controller support.
Additional Developer Tools and APIs
Apple is providing developers with a range of new tools and APIs that will push their app experience forward and enable them to create entirely new features — all built with privacy at the forefront.
- Xcode 13 adds powerful new team development features that are perfect for working with Xcode Cloud, as well as with GitHub, Bitbucket, and GitLab collaboration features.
- With SharePlay, popular apps like Disney+, ESPN+, HBO Max, Hulu, MasterClass, Paramount+, TikTok, and Twitch are building new types of shared experiences for users on iPhone, iPad, and Mac.1
- Third-party video-calling apps can take advantage of the latest FaceTime enhancements, including Voice Isolation, Wide Spectrum Audio, and Portrait mode.
- Messaging apps including Slack and WeChat can now share user status in conversations; apps like Uber Eats can have Siri announce incoming messages; and new Notification APIs enable high-priority and communication notifications from apps like Chase Mobile and Zomato to break through Do Not Disturb or a Focus.
- New camera APIs allow for better fused images and add the ability to capture high-quality stills and 1080p video in the same session.
- Apple Watch developers like Breakpoint Studio, Pandora, Qardio, and more are now creating new app experiences that offer a deeper level of customization, and are more responsive to their users’ environment.
- With TestFlight on the Mac, developers can test in-app purchases and other great Mac app features.
- StoreKit 2, which ensures in-app purchases are safe and secure for customers, now features new APIs for handling product entitlements and subscriber status, and testing support in both Xcode and the Apple sandbox environment.
- Web developers including Grammarly and Honey are now building extensions in Safari that are available across iPhone, iPad, and Mac. Developers can even create new, powerful extensions in the Mail app.
- Third-party navigation apps can now show a map view in a vehicle’s instrument cluster display, and a new CarPlay simulator for Mac vastly improves testing efficiency.
- Apps can offer the theater-like experience of spatial audio and place sounds all around to bring their content to life. And Physical Audio Spatialization Engine makes it easy for game developers to render true-to-life audio across all of Apple’s platforms.
- ShazamKit enables developers to integrate audio recognition technology directly from Shazam into their apps, making it possible not only to match music to Shazam’s vast catalog of songs, but also to match any prerecorded audio to custom results developers create.
AvailabilityDeveloper betas for iOS 15, iPadOS 15, macOS Monterey, watchOS 8, and tvOS 15 are available to Apple Developer Program members at developer.apple.com starting today. Xcode Cloud will be available as a limited free beta starting today, with expanding access throughout this summer and fall, and will be available to all developers next year. More details on pricing and availability for Xcode Cloud will be shared this fall.
