Sample CodevisionOSReviewed 2026-07-21View on Apple Developer

Exploring object tracking with ARKit

At a glance

Item Summary
Purpose Find and track real-world objects in visionOS using reference objects you train with Create ML.
App architecture ObjectTrackingApp composes WindowGroup + ImmersiveSpace around HomeView; AppState coordinates ARKit provider updates and maps anchors into RealityKit content.
Main patterns SwiftUI scene composition, SwiftUI–RealityKit bridge, Explicit immersive-space lifecycle, Observable state owner, Provider session boundary, Async update consumer
Project style Code-rich sample with 9 scanned Swift file(s) and 891 Swift line(s); resources and generated assets are excluded from those counts.

Project structure

Source bundle/
└── ObjectTracking/
    ├── ObjectTrackingApp.swift  # UIIdentifier, ObjectTrackingApp
    ├── App/
    │   ├── ObjectAnchorVisualization.swift  # ObjectAnchorVisualization, BoundingBoxOutline, MetricCoordinateLabel
    │   ├── ReferenceObjectLoader.swift  # ReferenceObjectLoader
    │   └── AppState.swift  # AppState
    └── Views/
        ├── HomeView.swift  # HomeView
        ├── ListEntryView.swift  # ListEntryView
        ├── ObjectTrackingRealityView.swift  # ObjectTrackingRealityView
        └── InfoLabel.swift  # InfoLabel

Structure observations

  • The runtime boundary is WindowGroup + ImmersiveSpace; the pruned tree lists only files that explain lifecycle, state, or framework integration.
  • App code is split into role-named views, models, managers, providers, components, or systems.

Overall architecture

Reference code

ObjectTracking/ObjectTrackingApp.swift:16 — the app or executable entry declares the outer scene lifecycle.

struct ObjectTrackingApp: App {
    // ...
}

The diagram is a responsibility flow, not a claim that every adjacent node directly calls the next. It keeps scene ownership, shared state, RealityKit content, and framework-provider work at separate levels.

Ownership and state

Ownership evidence

ObjectTracking/ObjectTrackingApp.swift:17 — representative stored state or the nearest verified lifecycle anchor.

    @State private var appState = AppState()
Owner Object or state Relationship Mutation authority
ObjectTrackingApp AppState as appState creates and retains Only the declaring scope writes
HomeView AppState as appState stores and coordinates The owning type coordinates writes
AppState ARKitSession as arkitSession creates and retains Only the declaring scope writes
HomeView UTType as referenceObjectUTType creates and retains Only the declaring scope writes

Ownership here is deliberately narrow: @Environment and weak references are shared links, initialized @State or stored services are lifecycle ownership, and a RealityView content closure owns additions to its entity graph without making the SwiftUI view a reference-type owner.

Class and protocol design

Type Responsibility Depends on or conforms to
ObjectTrackingApp (ObjectTracking/ObjectTrackingApp.swift:16) Declares app scenes and top-level dependency lifetime. App
HomeView (ObjectTracking/Views/HomeView.swift:13) Presents UI and forwards gestures or lifecycle events. View
AppState (ObjectTracking/App/AppState.swift:12) Owns observable feature state and domain transitions. Concrete framework collaborators
ListEntryView (ObjectTracking/Views/ListEntryView.swift:11) Presents UI and forwards gestures or lifecycle events. View
MetricCoordinateLabelView (ObjectTracking/App/ObjectAnchorVisualization.swift:170) Presents UI and forwards gestures or lifecycle events. View
ObjectTrackingRealityView (ObjectTracking/Views/ObjectTrackingRealityView.swift:13) Presents UI and forwards gestures or lifecycle events. View

The source defines no local substitution protocol in the reviewed boundary. Its protocol use is framework-facing (App, View, RealityKit/ARKit protocols, or platform adapters), so this document does not label the whole app protocol-oriented.

Access control

Symbol Access Verified effect Likely rationale
private(set) var worldSensingAuthorizationStatus = ARKitSession.Authori... (ObjectTracking/App/AppState.swift:40) private(set) The getter keeps its wider visibility, while mutation stays inside the declaring type and its permitted same-file extensions. Inference: Protect a state invariant while allowing observation.
private let arkitSession = ARKitSession() (ObjectTracking/App/AppState.swift:32) private Use is restricted to the declaration and same-file extensions permitted by Swift. Inference: Hide implementation details and lifecycle-sensitive state.
fileprivate init(anchor: ObjectAnchor, color: UIColor = .yellow, alpha:... (ObjectTracking/App/ObjectAnchorVisualization.swift:85) fileprivate Use is restricted to declarations in this source file. Inference: Share a helper across same-file extensions without making it module-wide.

No reviewed declaration uses public, open; unmodified Swift declarations are internal.

Reference code

ObjectTracking/App/AppState.swift:40 — representative visibility boundary.

    private(set) var worldSensingAuthorizationStatus = ARKitSession.AuthorizationStatus.notDetermined
    
    func startTracking() async -> ObjectTrackingProvider? {
        // ...
    }

Logic ownership and placement

Logic Owning type or file Placement rationale
Scene declaration and dependency lifetime ObjectTrackingApp The App/entry boundary determines window, volume, and immersive-space lifetime.
Presentation, attachments, and gestures HomeView SwiftUI view code forwards user intent and RealityView lifecycle events.
Shared feature state and commands AppState A role-named owner prevents sibling views from duplicating transitions.
Tracking authorization and update streams ObjectTracking/App/AppState.swift:32 Provider lifetime and async updates remain outside render-only view code.

Design patterns

Pattern Source evidence Purpose or tradeoff
SwiftUI scene composition ObjectTracking/ObjectTrackingApp.swift:16 Keeps windows, volumes, and immersive-space lifecycle visible at the app boundary.
SwiftUI–RealityKit bridge ObjectTracking/Views/ObjectTrackingRealityView.swift:21 Builds and updates a RealityKit entity graph from SwiftUI lifecycle closures.
Explicit immersive-space lifecycle ObjectTracking/ObjectTrackingApp.swift:33 Makes immersive presentation a scene transition rather than hidden global state.
Observable state owner ObjectTracking/App/AppState.swift:12 Shares feature state across multiple views without moving framework resources into view values.
Provider session boundary ObjectTracking/App/AppState.swift:32 Owns provider lifetime separately from the SwiftUI view tree.
Async update consumer ObjectTracking/App/ReferenceObjectLoader.swift:59 Consumes provider or event streams in cancellable structured tasks.

Naming conventions

  • Role suffixes are evidence, not decoration: App: ObjectTrackingApp; View: HomeView, ListEntryView, MetricCoordinateLabelView, ObjectTrackingRealityView.
  • Protocols: no app-defined protocol in the reviewed source.
  • Commands use verb-led methods: update, labelText, finishedOneFile, updateProgress, loadBuiltInReferenceObjects, loadReferenceObject, addReferenceObject, removeObject.
  • Files generally match their primary type; Views, Models, Managers, Providers, Components, Systems, and Packages folders describe architectural roles where present.

Architecture takeaways

  • Treat ObjectTrackingApp as the owner of scene declarations, not as the owner of every RealityKit entity created later.
  • Keep view-local interaction in SwiftUI, but move provider sessions, playback resources, shared game state, or transport state into a stable owner when their lifetime exceeds one render pass.
  • Run ARKit providers for the scene lifetime and consume their asynchronous updates in cancellable tasks; map anchors to entities at the boundary.
  • Model immersive-space open, transition, and close states explicitly so windows and immersive content cannot drift apart.

Source map

Source file Relevant symbols
ObjectTracking/ObjectTrackingApp.swift:10 UIIdentifier, ObjectTrackingApp
ObjectTracking/App/ObjectAnchorVisualization.swift:13 ObjectAnchorVisualization, BoundingBoxOutline, MetricCoordinateLabel, MetricCoordinateText, MetricCoordinateLabelView
ObjectTracking/App/ReferenceObjectLoader.swift:13 ReferenceObjectLoader
ObjectTracking/Views/HomeView.swift:13 HomeView
ObjectTracking/App/AppState.swift:12 AppState
ObjectTracking/Views/ListEntryView.swift:11 ListEntryView
ObjectTracking/Views/ObjectTrackingRealityView.swift:13 ObjectTrackingRealityView
ObjectTracking/Views/InfoLabel.swift:10 InfoLabel