WWDC 2024 Recap: What's New in Apple's Operating Systems

Andrew

• 2 min read

The latest Apple Worldwide Developers Conference (WWDC) brought a slew of updates and features across Apple's ecosystem. Marques Brownlee, a well-known tech reviewer, provides a thorough overview and analysis of these updates. Here’s a detailed look at what’s new in the various operating systems Apple announced.

VisionOS 2.0

VisionOS, the operating system for Apple’s Vision Pro, received its 2.0 update. Marques mentions that despite being called 2.0, it feels more like a 1.2 update due to its incremental changes. Key features include:

  • Wrist Turn Gesture: Quickly see time and battery percentage, similar to functionalities seen in other VR systems like Oculus Quest.
  • Immersive Media Features: Advanced machine learning turns old photos into spatial photos and allows the creation of spatial videos.
  • Enhanced Mac Mirroring: Allows up to double the resolution, enabling a gigantic ultrawide display if desired.

iOS 18

iOS 18 brings significant customization to the iPhone’s home screen, reminiscent of features Android users have enjoyed for years:

  • Home Screen Customization: Users can place icons anywhere on the grid and change the color of every icon and widget to match the wallpaper.
  • Control Center: Fully customizable across multiple pages, with more shortcuts and the ability to replace home screen shortcuts without jailbreaking.
  • Hidden Apps and Scheduled Texts: Enhanced privacy and functionality in iMessage, including satellite messaging and RCS support.
  • Game Mode: Minimizes background activity and Bluetooth latency for peripherals.
  • Automatic Categorization in Mail App: Helps manage emails more efficiently.

iPadOS 18

The iPad gets full home screen customization and a new control center, similar to iOS 18, but the standout feature is:

  • Calculator App: A new calculator app with handwriting recognition and real-time equation solving using the Apple Pencil. It supports variables and can graph equations with dynamic adjustments.

macOS Sequoia

The latest version of macOS, named Sequoia, includes several useful features:

  • Automatic Window Snapping: Built-in window management without third-party apps.
  • Backgrounds for Webcam Apps: Allows customized backgrounds for any app using the webcam.
  • Standalone Password App: Makes password management more accessible.
  • iPhone Mirroring: Wirelessly see your iPhone’s screen on your Mac, merging notifications and audio, and allowing drag-and-drop between devices.

WatchOS and tvOS

Minor updates include:

  • WatchOS: New training mode that balances workout trends over time.
  • tvOS: Swipe down on the remote to see actor names, character names, and songs in real time. There’s also a feature to boost voices over music.

Apple Intelligence

The most anticipated part of the keynote was Apple’s foray into AI, rebranded as Apple Intelligence. Unlike other companies, Apple focused on integrating AI into device functionalities without overtly highlighting it:

  • Writing Tools: Summarize, rewrite, or proofread text in apps like Pages and Keynote using large language models.
  • Cleanup Tool in Photos App: Similar to Google’s Magic Eraser, it allows users to remove unwanted elements from photos.
  • Generative Emojis and Image Playground: Create custom emojis and images using diffusion models.
  • Siri Enhancements: Improved context understanding and in-app actions, plus the ability to type to Siri.

On-Device AI and Privacy

Apple’s approach emphasizes on-device processing for speed and privacy. For complex tasks, it may use Apple’s Private Cloud compute or ask for user permission to access OpenAI’s ChatGPT-4:

  • On-Device Processing: Most AI functionalities are processed locally.
  • Private Cloud Compute: For tasks too complex for local processing.
  • Integration with ChatGPT-4: With user consent, it can access ChatGPT-4 for specific queries, ensuring privacy by obscuring IP addresses and never storing requests.

Marques Brownlee's Take

Marques Brownlee suggests that the integration of Apple Intelligence marks a new era for Apple, overshadowing traditional features. He points out that features like home screen customization, though long-awaited, pale in comparison to the potential of AI enhancements.

In conclusion, WWDC 2024 showcased Apple's continued commitment to enhancing user experience through thoughtful integration of new technologies, with AI taking a central role in this evolution.