استاد ARKit، ویرایش دوم: پلتفرم توسعه اپلیکیشن واقعیت افزودهٔ اپل

Table of Contents About the Author About the Technical Reviewer Introduction Chapter 1: Why Augmented Reality A New Canvas for Developers Problem-Solving Through AR Redefining Spaces with AR The Classroom of Tomorrow The Workplace of Tomorrow Choosing ARKit Who Is This Book For? Chapter 2: ARKit: Under the Hood Unveiling the Intricacies of ARKit Core Mechanics of ARKit Graphics Frameworks: Bringing AR to Life SceneKit SpriteKit Metal RealityKit Session Management: The Heartbeat of ARKit Essential Session States Advanced Tracking Techniques Up Next: Designing for AR Chapter 3: Designing and Prototyping an Augmented Reality Experience Ideas Augmented Reality Benefits Physical World Environment Physical World Objects Overlaying Virtual Objects Idea Case Studies: Evaluating Augmented Reality’s Potential Case Study #1: Virtual Shoe Store Case Study #2: Computer Science Education The Startup: Seamless Integration with the Real World Invisible Detection of the Physical World Standardizing User Interfaces User Environment: Adapting to Different Scales Table Scale Room Scale World Scale Defined and Undefined Space Augmented Reality Experience Prototyping Prototyping Methods Conclusion: Harnessing Augmented Reality for Transformative Experiences Chapter 4: Building Your First ARKit App with SceneKit Purpose Content Creating a New Project Setting Up ARKit SceneKit View Connecting IBOutlet Configuring ARSCNView Session Allowing Camera Usage Adding 3D Object to ARSCNView Adding Tap Gesture Recognizer to ARSCNView Removing Object from ARSCNView Adding Multiple Objects to ARSCNView Hit-Test vs. Raycast Differences Between hitTest and raycast Use Cases Implementing Pan Gesture Recognizer on ARSCNView Trying Out the Final App Wrap-Up Chapter 5: Understanding and Implementing 3D Objects What You’ll Learn 3D Objects Creation Toolsets 3D Objects Creation Toolsets Online Resources for 3D Objects TurboSquid CGTrader Sketchfab Free3D SceneKit Supported Format Getting Started with the Starter Project Implementing a Single Node 3D Object Adding Basic Lighting Implementing a Multiple Nodes 3D Object Loading USDZ into Scene View Chapter 6: Detecting Horizontal Planes and Adding 3D Objects with Raycast in SceneKit What You’ll Discover Understanding Horizontal Planes Building the App Detecting Horizontal Planes Visualizing Horizontal Planes Expanding Horizontal Planes Adding Objects on Horizontal Planes Raycasting for Physical World Surface Positioning Refactoring for Segmented Control and Adding Additional Objects Up Next Chapter 7: Understanding Physics by Launching a Rocket Ship Physics Body Explained Physics Body Types Static Dynamic Kinematic Creating a Physics Body Attaching a Static Physics Body Attaching a Dynamic Physics Body Applying Force Adding SceneKit Particle System and Changing Physics Properties Adding Swipe Gestures Showtime Implementing Custom Object Collision Detection Logic Category Bitmasks Collision Bitmasks Contact Test Bitmasks Implementing the Solution Chapter 8: Light Estimation and Environment Texturing What You’ll Implement and Learn Getting Started Creating a Sphere Node Adding Light Node Testing Light Properties Showing/Hiding the Light Estimation Switch Working with the Light Estimation Switch Implementing Light Estimation Trying Out the App Demo Environment Texturing Physically Based Lighting Model, Metalness, and Roughness Chapter 9: 2D Image Recognition and Filter Modification What You’ll Accomplish Getting Started Enabling Image Recognition Physical Image Size Setting Configuration for Image Recognition Recognizing Images with ARImageAnchor Testing the Demo App Overlaying 3D Objects on Detected Images Dynamically Create ARReferenceImage Programmatically Chapter 10: Saving and Restoring World Mapping Data to Create a Persistent AR Experience Getting Started Working with ARWorldMap Setting Up the World Map Local Document Directory Archiving an AR World Map As Data Saving an AR World Map Data into Your Document Directory Loading an AR World Map Data from Your Document Directory Setting the Scene View Configuration’s Initial World Map Persistent AR Demo Visualizing a World Map in 3D Space with ARPointCloud Conclusion Chapter 11: Creating Immersive Audio Experiences Implementing Spatial Sound Awareness Stereo to Mono Audio Channels Conversion Tools Chapter 12: Working with SpriteKit and ARKit Getting Started Working with SKScene What Is SKScene? Setting Up a Custom SKScene Randomly Placing 2D Object in 3D space Positioning a SpriteKit Node on Tap Detecting Change in Time in SKScene Detecting Touches in SKScene Setting Up SKScene with View Controller Setting Up the Time Label’s Timer Creating the SpriteKit Node Working with ARSKViewDelegate Working with SceneGestureDelegate Setting the Delegates Running the Game Conclusion Chapter 13: Advancing App with Real-Time Image Analysis, Machine Learning, and Vision Getting Started Creating an Image Analysis Request for Your Core ML Model Classifying Camera’s Pixel Buffer from Video Frame Controlling Toy Robot with Hand Gesture Analysis Adding Toy Robot Upon Plane Detection Showtime Chapter 14: Crafting Your Digital Universe with 3D Assets Crafting a Tower in SpriteKit Crafting a Fireball in SceneKit Crafting a Troop in Reality Composer Making Things More Interesting with Particle Emitter Conclusion Chapter 15: Building Shared Experiences with Multipeer Connectivity Getting Started Implementing ARCoachingOverlayView Setting up MultipeerConnectivity Handling MCSessionDelegate Handling MCNearbyServiceBrowserDelegate Handling MCNearbyServiceAdvertiserDelegate Setting up ViewController for MultipeerConnectivity Sending Data in MCSession Key-Value Observing (KVO) Encoding Collaboration Data Receiving Peer Data Making Virtual Content with AnchorEntity Working with ARParticipantAnchor Discovering Peers Joining Peers Leaving Peers Where to Go from Here? Chapter 16: Face Tracking Getting Started Preparing Your Model Entity for ARFaceAnchor Adding Your Anchor Entity onto ARFaceAnchor Updating Anchor Entity from New ARFaceAnchor Where to Go from Here? Chapter 17: Simultaneously Integrate Face Tracking and World Tracking Getting Started Encapsulating Custom Entity Properties Creating the Entity’s API Integrating the Custom Entity with the View Controller Preparing the Custom Entity for Notification Triggers and Actions Setting Up the Custom Entity Notification Triggers Setting Up the Custom Entity Action Notifiers Testing the Notification Triggers and Actions Integration Where to Go from Here? Chapter 18: Body Motion Capture Understanding the Skeleton Capturing a Person’s Body Motion in Real Time Using RealityKit Integrating the Body Motion Capture Feature with a Rigged Model Generating Your Rigged Model Placing Objects Relative to Various Joints Captured on a Body Calculating Distances Between Joints Where to Go from Here? Chapter 19: People Occlusion Under the Hood of People Occlusion Knowing People Occlusion Features Configuring RealityKit for People Occlusion Setting Frame Semantics for Person Segmentation with Depth Turning Off People Occlusion for Performance Where to Go from Here? Chapter 20: Working with SwiftUI and ARKit Getting Started Setting Up a Custom ARView Making a View Model Observable Object for ARView Creating a UIViewRepresentable to Contain ARView Integrating the Coordinator Pattern Displaying ARView in SwiftUI Where to Go from Here? Chapter 21: Record Augmented Reality Experiences with ReplayKit Understanding the Purpose of ReplayKit Integrating ReplayKit into the Project Recording Augmented Reality Experiences Handling Preview Controller Did Finish Protocol Saving Augmented Reality Experiences Wrapping the Recording Logic Inside IBAction Where to Go from Here? Index df-Capture.PNG