Enhancing live video by leveraging TrueDepth camera data

At a glance

Project structure

Source bundle/
├── TrueDepthBackdrop/
│   ├── AppDelegate.swift
│   ├── CameraViewController.swift
│   ├── PreviewMetalView.swift
│   ├── Shaders/
│   │   └── PassThrough.metal
│   ├── Base.lproj/
│   │   ├── LaunchScreen.storyboard
│   │   └── Main.storyboard
│   └── Info.plist
├── Configuration/
│   └── SampleCode.xcconfig
└── TrueDepthBackdrop.xcodeproj/
    ├── .xcodesamplecode.plist
    └── project.pbxproj

Structure observations

• Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
• Primary languages: Metal, Swift.
• The verified tree contains 6 project/configuration file(s) and 6 source declaration(s).

Overall architecture

flowchart LR
    N1["AppDelegate"]
    N2["CameraViewController"]
    N3["AVFoundation APIs"]
    N1 --> N2
    N2 --> N3

Reference code

TrueDepthBackdrop/AppDelegate.swift:10 — architecture anchor

@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
    var window: UIWindow?
}

Interpretation

The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into AVFoundation.

Ownership and state

classDiagram
    AppDelegate o-- UIWindow : window
    CameraViewController o-- SessionSetupResult : setupResult
    CameraViewController *-- AVCaptureSession : session
    CameraViewController *-- DispatchQueue : sessionQueue

Ownership evidence

TrueDepthBackdrop/AppDelegate.swift:12 — stored dependency or nearest verified ownership anchor

@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
    var window: UIWindow?
}

Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.

Concurrency, scheduling, and thread safety

Evidence limit: actor isolation, async/await, or Task creation does not by itself prove background-thread execution; Sendable conformance alone does not prove thread-safe mutation.

@MainActor/MainActor.run, DispatchQueue.main, and RunLoop.main are reported as distinct isolation, queue, and event-loop mechanisms. A plain Task is kept separate from Task.detached; neither is labeled as a background thread.

Reference code

TrueDepthBackdrop/CameraViewController.swift:37 — representative execution boundary

@available(iOS 11.1, *)
class CameraViewController: UIViewController, AVCaptureDataOutputSynchronizerDelegate, UIImagePickerControllerDelegate, UINavigationControllerDelegate {
    // ...
    private let sessionQueue = DispatchQueue(label: "session queue", attributes: [], autoreleaseFrequency: .workItem)
    // ...
}

State propagation, frameworks, and dependencies

Evidence limit: an import proves a source-level compilation dependency at the cited line; it does not prove runtime use, architectural adoption, or whether a Swift package is a direct application dependency.

receive(on:) describes downstream delivery scheduling, while subscribe(on:) describes upstream subscription/request/cancel scheduling. An import Combine alone establishes neither behavior nor a Store, reducer, Redux, or other application architecture.

Class and protocol design

TrueDepthBackdrop/AppDelegate.swift:11 — representative type boundary

@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
    var window: UIWindow?
}

No local protocol conformance is claimed as protocol-oriented design; external framework conformances are listed only as dependencies.

Access control

Reference code

TrueDepthBackdrop/CameraViewController.swift:30 — representative boundary

@available(iOS 11.1, *)
class CameraViewController: UIViewController, AVCaptureDataOutputSynchronizerDelegate, UIImagePickerControllerDelegate, UINavigationControllerDelegate {
    // ...
    private var setupResult: SessionSetupResult = .success
    // ...
}

Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.

Logic ownership and placement

Design patterns

Naming conventions

• Types: Controller: CameraViewController; Delegate: AppDelegate; View: PreviewMetalView.
• Protocols: no local protocol declaration in the scanned source.
• Methods: viewDidLoad, viewWillAppear, viewWillDisappear, didEnterBackground, willEnterForground, viewWillTransition, addObservers, observeValue.
• Files: TrueDepthBackdrop/AppDelegate.swift, TrueDepthBackdrop/CameraViewController.swift, TrueDepthBackdrop/PreviewMetalView.swift.

Architecture takeaways

• AppDelegate is the main source-visible entry or composition anchor for this sample.
• Framework work reaches UIKit, AVFoundation, CoreVideo, Metal through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
• Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
• Access-control conclusions separate verified language visibility from the likely design rationale.
• The source does not justify labeling the design protocol-oriented.

Source map

• Official Apple documentation