AIコンサル

WWDC 2023 — June 5 | Apple_03

2026-01-21Hamamoto

WWDC 2023 — June 5 | Apple_03. Allessandra McGinnis: Let's look at Apple Vision Pro in real-world work situations. Vision Pro includes the apps you love and rely on every day.

WWDC 2023 — June 5 | Apple_03
シェア

Hello from TIMEWELL's Hamamoto

Hello, this is Hamamoto from TIMEWELL Inc.

Looking for AI training and consulting?

Learn about WARP training programs and consulting services in our materials.

WWDC 2023 — June 5 | Apple_03

WWDC 2023 — June 5 | Apple_03

Previous article (WWDC 2023 — June 5 | Apple_02) → https://one-x.jp/PMiwA1Mb-2/PN8_s4tc

Allessandra McGinnis: Let's look at Apple Vision Pro in real-world work situations. Vision Pro includes the apps you love and rely on every day. Notes, Messages, Keynote, Safari, FaceTime — the way you use all of them is transformed.

And of course, Vision Pro stays in constant sync with your iPhone, iPad, and Mac. Notes, Messages, photos, documents — everything is automatically kept up to date in iCloud. This is what you see with Vision Pro. Your entire world becomes a canvas for apps, so you can place them at exactly the right size wherever you are and whatever you're doing.

Let's start with Safari. Web pages are big — perfect for watching video or reading articles. Even small text remains crisp as you scroll through pages and is readable from any angle. And Safari expands so you can see all your open tabs. You can arrange multiple apps in the space around you however you like.

You can layer them, or place them above, below, or to the side of each other. Like this — just turn your head and you can shift focus from Safari to a Freeform board. And content within apps isn't limited to two dimensions. A 3D object you receive in Messages can be pulled out and examined from every angle, as if it were right there in front of you.

It's magical! While wearing Vision Pro, you can see the world around you clearly, so you remain present in your space and connected with others. And you can easily interact with the world around you. That's why Apple Vision Pro gives you the perfect setup for whatever you're doing, and makes multitasking easy.

Listen to your favorite playlist in Apple Music while checking a to-do list in Notes, researching your next trip in Safari, and chatting with friends about plans in Messages. Use the virtual keyboard or dictation for text input. With Vision Pro, there's room for all of it. Vision Pro also works seamlessly with familiar Bluetooth accessories like Magic Trackpad and Magic Keyboard — great for writing long emails or building a spreadsheet in Numbers.

And you can even wirelessly bring your Mac into Apple Vision Pro just by looking at it. Place and expand your Mac's screen anywhere you want and you've got an enormous, private, portable 4K display. Vision Pro is designed to let you use your Mac seamlessly in your ideal workspace. So you can turn the Digital Crown in the White Sands environment, or use Vision Pro's other apps alongside your Mac.

This Powerful Combination Makes Apple Vision Pro Ideal for Both Office and Remote Work

This powerful combination makes Apple Vision Pro ideal for both office and remote work.

Because Vision Pro is also incredible for travel. Connecting and collaborating with colleagues becomes easy. For example, you can collaborate with your team on the same document remotely.

And of course, Apple Vision Pro delivers an incredible FaceTime experience. FaceTime has become spatial, using the space of the room around you. When you join a group call, everyone appears life-size. As new people join, FaceTime continues to expand. With Spatial Audio built into Vision Pro, each person's voice comes from the position of their tile, making group conversations easier and more natural.

And within FaceTime, you can share apps with others and use them together with SharePlay. And while sharing an app, you can still see everyone in large video tiles. This is great for reviewing presentations, sharing photos and videos, watching a movie together, and much more. FaceTime on Vision Pro works seamlessly with other Apple devices — iPhone, iPad, Mac — so everyone can join.

At work, Apple Vision Pro gives you powerful new ways to connect with people and creates the ultimate workspace for what you want to do, wherever you are. To tell you how Vision Pro changes the experience at home, here's En.

En Kelly: Apple Vision Pro brings the power of spatial computing to many of the things you do at home.

You can capture and experience your photos and videos in magical new ways, redefining how you relive precious moments. When you select a photo, you can watch the room around you dim. Your library of photos and videos looks breathtakingly beautiful on Vision Pro — with vivid color and incredible detail. Make them the size of the room or zoom in to feel closer to the moment.

And panoramas are breathtakingly beautiful. With Vision Pro, every panorama you've ever taken with iPhone expands to life-size and wraps around you. It's as if you're standing right where you took the shot. With Vision Pro's powerful capabilities, we were able to go further and add an entirely new dimension to photos and videos.

Vision Pro is Apple's first 3D camera. With Spatial Audio, you can capture and relive memories in 3D. A feeling that no two-dimensional screen can match — as if you've stepped back into that very moment. Imagine being able to relive a special moment at your daughter's birthday.

The Astonishing Depth of Spatial Video Feels Like Looking Into a Memory

The astonishing depth of spatial video makes it feel like looking into a memory. Capturing spatial photos and videos is easy — just press a button. And with EyeSight, people around you can clearly tell when you're recording. Capture magical moments with your children and share them with family, reliving them again and again over the years.

Spatial photos and videos bring your most precious moments and the people you love closer than ever.

Apple Vision Pro also delivers extraordinary entertainment experiences. We all love watching great movies with great sound in a darkened theater. Vision Pro delivers that and more with Spatial Cinema, which transforms your space.

You have a gorgeous screen you can adjust to the perfect size. Vision Pro automatically dims the room around you, casts a beautiful glow, and immerses you in Spatial Audio.

Set up an environment like Mount Hood, and the screen expands beyond the walls of your room for an epic viewing experience up to 100 feet wide.

And with the Cinema environment, you can transform any room into your own private movie theater. This environment is designed to let you fully focus on the film and provides an amazing viewing experience you can take anywhere — even on a plane. Put on your AirPods, sit back, set up the environment, and the seats and sounds around you fade away as you enjoy the movie.

Incredible. And of course, you can enjoy your favorite movies and TV shows from Apple TV+ and other content services on Vision Pro. This incredible movie experience goes beyond two dimensions. You can watch 3D movies too. On Vision Pro, 3D movies have astonishing depth and crisp motion — it's impossible to see this on a 2D screen; you feel like you're looking right into the film.

No device in the world can offer a 3D movie experience of this quality. And beyond film, you can experience interactive storytelling in breathtaking new ways. For example, "Encounter" lets you watch dinosaurs interact right in front of you as you look back at a prehistoric age.

Beyond movies, you can play your favorite Apple Arcade games like "NBA 2K23" on an incredibly large screen with remarkable audio and game controller support. Over 100 Arcade games will be available from day one. This is just the beginning of how gaming will evolve on Vision Pro.

Season Finales, 3D Movies, Immersive Video — Vision Pro Is the Best Way to Enjoy Your Favorite Entertainment

Season finales, 3D movies, immersive video — Vision Pro is the best way to enjoy your favorite entertainment. And with spatial photos and videos, you can capture and relive precious moments in magical new ways. Back to Tim.

Tim: Apple Vision Pro will change how we communicate, collaborate, work, and enjoy entertainment.

And The Walt Disney Company is the world's leader in entertainment. So let me introduce Disney's CEO, Bob Iger.

Bob Iger: Thank you, Tim. It's an honor to be here with all of you for this momentous occasion. As The Walt Disney Company celebrates its 100th anniversary, we look back proudly on our rich legacy of storytelling innovation while looking ahead to our future with enthusiasm and optimism.

We're always looking for new ways to entertain, inform, and inspire fans by combining extraordinary creativity with breakthrough technology, and we believe Apple Vision Pro is a revolutionary platform to realize our vision. When I first used Apple Vision Pro, what impressed me most was the ability to create deeply personal experiences that bring fans closer to the characters they love and draw them more deeply into our stories.

This platform will allow us to deliver Disney to our fans in ways that were never before possible. I'm thrilled to show you just a glimpse of what we've been dreaming about. Please take a look.

Bob: Once again, we're so proud to partner with the world's greatest storytelling company and the world's most innovative technology company to deliver real-life magic.

And I'm thrilled to announce that Disney+ will be available from day one. These are just some of the ways Disney will come to your world with Apple Vision Pro, and we look forward to sharing much more in the months ahead. Thank you, Tim!

Tim: Thank you, Bob! We're so excited to work together to see all the incredible things Disney will do with the capabilities of Apple Vision Pro.

This kind of breakthrough innovation required tremendous advances in both design and technology. To tell you about Vision Pro's incredible new design, here's Richard.

Richard Howarth: Opportunities to Define an Entirely New Category

Richard Howarth: Opportunities to define an entirely new category and establish principles that will influence design for years to come don't come along very often.

Apple Vision Pro brings together decades of our experience designing high-performance products like Mac, mobile products like iPhone, and wearable products like Apple Watch. All of that has come together in our most ambitious product yet. To achieve our goals of performance, mobility, and wearability, we drew on the most advanced and lightest materials available.

The entire front of the product is a single piece of three-dimensionally formed laminated glass. This glass is optically polished, functioning as the lens for EyeSight and the many other cameras and sensors that need to see the world. It also features a Digital Crown for invoking Home View and rotating to control immersion in environments.

Custom machined from a single aluminum alloy, it curves gently to wrap around the face. This frame is the primary structural element of Vision Pro, completing the form while housing and protecting internal components. Displays, cameras, sensors, and a high-performance computer — an extraordinary amount of technology packed into an incredibly compact form.

In contrast to the precise front, we crafted an abundance of soft textile parts to achieve a comfortable fit. We studied thousands of heads to deeply understand the wide variation in cheekbone width, facial angle, and head shape. This led us to design a modular system that allows the product to be tailored to fit you precisely.

The Light Seal comes in various shapes and sizes and curves to fit the face, providing a truly precise fit. Flexible straps extending from the frame conform to the head, keeping the audio pods close to the ears. This enables rich Spatial Audio while maintaining awareness of surroundings.

The headband integrates 3D knitting to create a unique ribbed structure that provides cushioning, breathability, and stretch. The band attaches with a simple, reliable mechanism so you can swap it for a different size or style. A conveniently positioned adjustment dial keeps it comfortably secure and allows for micro-adjustments during use.

For glasses wearers, we worked with ZEISS to create custom optical inserts that attach magnetically to the lenses. They support a range of vision correction without compromising display performance or eye-tracking accuracy. Vision Pro can be used plugged in all day, or with an external high-performance battery for up to two hours.

With the battery separate, there's no weight on your head. Connected via a soft, braided cable to a soft aluminum form that fits in your pocket. This is the design of Vision Pro — our first wearable spatial computer. A remarkably capable and powerful tool that melds digital content with your world.

To Tell You About the Technology Developed to Enable These Extraordinary Experiences

To tell you about the technology developed to enable these extraordinary experiences, here's Mike.

Mike Rockwell: Creating our first spatial computer required invention in virtually every aspect of the system. Apple Vision Pro needed to deliver an enormous amount of computational performance in a compact, wearable form factor.

It required an advanced, real-time sensor system and convincing spatial audio. And of course, a technological breakthrough in the display. Your eyes see the world with incredible resolution and color fidelity. To give them what they need, we had to invent a display system with a massive pixel count in a tiny form factor.

A display where the pixels disappear into smooth, continuous imagery. We started with a micro-OLED Apple silicon backplane that fits 64 pixels into the space of one iPhone pixel — just 7.5 microns wide. Vision Pro packs 23 million pixels across two panels the size of a postage stamp.

That's more pixels than a 4K TV for each eye. To magnify these panels and wrap them around you required a refined lens solution. We designed custom three-element lenses with incredible sharpness and clarity. The result: a display that delivers an amazing experience everywhere you look — something impossible on other devices.

True 4K resolution, wide color, and high dynamic range at massive scale. And fine text is crisp from any angle. That matters when browsing the web, reading messages, or writing email. Now, audio. What you hear is critical to how you perceive the world.

We wanted sound to feel like it comes from the surrounding space — blended into the real world. So Vision Pro features an entirely new Spatial Audio system. It incorporates dual-driver audio pods that deliver personalized sound, creating ambient Spatial Audio that makes your brain perceive sound as coming from the environment around you.

Vision Pro can analyze the characteristics and materials of a space using a technique called audio ray tracing and match sound to your room. In this way, Vision Pro uses an advanced sensor array to deliver sound tuned to your room. It also handles feeding high-resolution imagery to the displays, precise head and hand tracking, and real-time 3D mapping.

The high-performance eye-tracking system uses high-speed cameras and a ring of LEDs to project invisible light patterns, enabling responsive and intuitive input. Its precision is so high that it frees you completely from clumsy hardware controllers. Processing all the information from these sensors while simultaneously delivering an ultra-high-resolution experience requires a system with enormous sustained computational power.

It Also Needs to Be Calm and Silent

It also needs to be calm and silent. At the heart of this system is Apple silicon with a unique dual-chip design. It starts with the Apple M2 chip. While delivering incredible computational performance, Vision Pro stays at a comfortable temperature and operates near silently. Running in parallel is an entirely new chip: R1.

This dedicated chip was purpose-built for the demanding task of real-time sensor processing. It processes input from 12 cameras, five sensors, and six microphones. In other headwear systems, the latency between sensors and displays can cause motion discomfort. R1 eliminates that latency almost entirely, streaming new images to the displays within 12 milliseconds.

That's 8 times faster than the blink of an eye! M2 delivers incredible standalone performance in Apple Vision Pro, while R1 makes the experience feel like it's happening right in front of you. We also gave deep consideration to how others can interact with you while you're wearing Vision Pro.

EyeSight uses a unique curved OLED panel with a lenticular lens to display the correct perspective of your eyes to each person looking at you. The result is a 3D display that appears as if the device is transparent. For digital communication like FaceTime, Vision Pro can represent you faithfully — not just conveying your eyes but giving a full sense of who you are.

This was one of the hardest challenges in building Apple Vision Pro. The video camera isn't looking at you — and even if it were, you're wearing something over your eyes. We used cutting-edge machine learning to develop an innovative solution. After a simple setup process using Vision Pro's front sensors, the system uses an advanced encoder-decoder neural network to create your Digital Persona.

This network was trained on thousands of diverse individuals. It enables natural expressions that follow the movements of your face and hands. With a Persona, you can communicate with over a billion FaceTime-capable devices. Viewed on another Vision Pro, your Persona has a sense of volume and depth that's impossible with traditional video.

This advanced technology wouldn't be possible without a powerful operating system called visionOS. visionOS is built on the foundation of decades of innovation in macOS, iOS, and iPadOS. We've added many new capabilities to support the low-latency requirements of spatial computing — including a new real-time execution engine that guarantees performance for latency-critical workloads, a dynamic foveated rendering pipeline that delivers maximum image quality wherever each eye looks, every frame, and the world's first multi-app 3D engine that can run different apps within the same simulation simultaneously. Critically, we've extended existing application frameworks to natively support spatial experiences. visionOS is truly the first OS designed from the ground up for spatial computing.

With all these breakthrough technologies, Vision Pro is truly a one-of-a-kind device. There's nothing else like it. Apple Vision Pro is not merely a new product. It's the start of an entirely new platform. To tell you what this means for developers, here's Susan.

Susan Prescott: We've been working toward this day for years. We're incredibly excited about the possibilities Vision Pro brings to developers.

Vision Pro Enables Developers to Reimagine Existing Applications

Vision Pro enables developers to reimagine existing applications and create entirely new ones. Spatial experiences come in many forms, including 3D objects that look and feel real. We gave a number of developers early access to Vision Pro to see what was possible, and they've created some truly incredible apps.

Complete HeartX creates an interactive 3D beating heart, offering students an entirely new perspective on the body's most vital function. JigSpace allows designers to collaboratively review concepts, like the design of an Alfa Romeo F1 car. And companies can use PTC's Stages to review and approve new production lines before manufacturing begins.

Remix your favorite tracks with djay and its reinvented spatial interface. And SkyGuide lets you see sights invisible to the naked eye, stepping into your own private planetarium. And Vision Pro is incredible for everyday productivity. Microsoft apps like Excel, Word, and Teams take full advantage of Vision Pro's expansive canvas and sharp text rendering.

Popular video conferencing apps can use Digital Personas to collaborate easily on this device. And of course, our developer tools are built with Vision Pro in mind. Developers can use familiar tools and frameworks — Xcode, SwiftUI, RealityKit, ARKit — to create new apps for Vision Pro.

We've also built Reality Composer Pro, which lets you easily assemble complex scenes with realistic objects, streamlining the preparation of 3D content for spatial apps. The same frameworks available in iPadOS and iOS are included in visionOS too — which means that hundreds of thousands of iPad and iPhone apps will be available on Vision Pro at launch.

So apps like Adobe Lightroom can be used on an enormous screen, and these apps are easily controlled using only your eyes and hands. We know there's a community of developers who've been building great 3D apps for years. And today, we're thrilled to share that we've worked with Unity to bring those apps to Vision Pro.

So popular Unity-based games and apps can fully utilize visionOS features like passthrough, high-resolution rendering, and native gestures. And these Unity applications run natively on Apple Vision Pro, so they can be rendered alongside other visionOS applications. Apple Vision Pro will have a brand-new App Store where users can discover and download all apps built for visionOS, as well as compatible iPad and iPhone apps.

We'll have much more to share about developer tools and everything you need to get started at "Platforms State of the Union" this afternoon. We can't wait to see what developers will build on this breakthrough platform. Back to Mike.

Mike: We've been building toward this moment for years.

Working with Unity to Deeply Support Their Tools

By working with Unity to deeply support their tools and combining them with visionOS's world-class rendering and powerful display, Apple Vision Pro is a fantastic platform for game developers. Apple's incredible developer and app ecosystem is one of the reasons people love Apple products. And another is an unwavering focus on privacy and security.

The moment you put on Apple Vision Pro, you're authenticated in a secure, easy system called Optic ID. This new system uses the uniqueness of your iris — which is different even for identical twins — to instantly unlock Vision Pro. Optic ID data is encrypted and never leaves the device, accessible only to the Secure Enclave processor — just like Face ID.

Optic ID works seamlessly with features like Apple Pay, App Store purchases, and Password AutoFill. And we've designed privacy into Vision Pro in several important ways. For example, where you're looking is deeply personal — it can even reveal what you're thinking. In Apple Vision Pro, we've made sure that only you know where you're looking.

Eye input is separated into a background process, so apps and websites can't tell where you're looking. Only when you tap your finger — similar to a mouse click or tap on other Apple devices — is the result communicated. And camera data is processed at the system level, so individual apps don't need to see what's around you.

The world-class security and privacy features stay close to you as you enjoy the Vision Pro experience. That's Apple Vision Pro — the most advanced display system ever created, a revolutionary Spatial Audio system, two powerful Apple silicon chips, a breakthrough spatial computing system, and a gorgeous design in aerospace-grade alloy — the most advanced personal electronics device ever made.

In fact, so much invention went into Vision Pro that we applied for over 5,000 patents during development. It's hard to believe that everything Vision Pro offers is possible in a standalone spatial computer you can take anywhere. With Vision Pro, you can replace the many monitors on your desk with an infinite screen area, making you more productive than ever.

It delivers extraordinary entertainment and personalized spatial audio. And it provides powerful new ways to collaborate and connect. And in capturing and reliving memories, Vision Pro is in a class of its own. Even if you bought the latest TV, a surround sound system, a powerful computer with multiple high-resolution displays, and a high-end camera — none of that comes close to what Vision Pro delivers.

Apple Vision Pro starts at $3,499. It goes on sale in early next year at apple.com and Apple Stores in the United States, with more countries coming later next year. WWDC is the ideal time to share in-depth information about this incredible new platform with developers. And we'll be working with developers over the coming months to create new and innovative applications for Vision Pro's launch and beyond.

Apple Stores were made for moments like this. Come work with our team to learn about this new platform in depth, experience demos, and personalize your Vision Pro fit. We can't wait for you to experience Apple Vision Pro. Back to Tim.

Tim: Thank you, Mike, and Thank You to All Our Presenters

Tim: Thank you, Mike, and thank you to all our presenters.

And a huge thank you to everyone at Apple who made today happen. It's been a very big day. We announced the world's best 15-inch notebook, the all-new MacBook Air, and our two most powerful Macs ever with Apple silicon, Mac Studio and Mac Pro. We shared the direction for our incredible software platforms — iOS, iPadOS, macOS, watchOS, and the software that powers Home and Audio.

And of course, we announced Apple Vision Pro. Some products change how we see technology and its role in our lives. We believe Apple Vision Pro is a revolutionary product with the performance, immersion, and capability that only Apple could deliver. Together with visionOS, Apple Vision Pro introduces an entirely new spatial computing platform, delivering remarkable possibilities for users and exciting new opportunities for developers.

And this is just the beginning. We've made an ad for Apple Vision Pro that I'd like to share with you now.

We hope you're as excited as we are about Apple Vision Pro.

And we'll continue to share much more about visionOS and our other platforms throughout the conference. Thank you for joining us. Have a great week, and a great WWDC!

Source: https://www.youtube.com/watch?v=GYkq9Rgoj8E

This event report was produced by TIMEWELL, an online business support service.

Source: https://one-x.jp/PMiwA1Mb/ZFDV98nD

Considering AI adoption for your organization?

Our DX and data strategy experts will design the optimal AI adoption plan for your business. First consultation is free.

Share this article if you found it useful

シェア

Newsletter

Get the latest AI and DX insights delivered weekly

Your email will only be used for newsletter delivery.

無料診断ツール

あなたのAIリテラシー、診断してみませんか?

5分で分かるAIリテラシー診断。活用レベルからセキュリティ意識まで、7つの観点で評価します。

Learn More About AIコンサル

Discover the features and case studies for AIコンサル.