Streaming depth data from the TrueDepth camera

At a glance

Project structure

Source bundle/
└── TrueDepthStreamer/
    ├── DepthToJETConverter.swift
    ├── AppDelegate.swift
    ├── CameraViewController.swift
    ├── PreviewMetalView.swift
    ├── FilterRenderer.swift
    ├── PointCloud/
    │   ├── PointCloudMetalView.h
    │   └── PointCloudMetalView.mm
    ├── Shaders/
    │   ├── DepthToJET.metal
    │   └── Mixer.metal
    ├── VideoMixer.swift
    ├── HistogramCalculator.h
    └── HistogramCalculator.m

Structure observations

• Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
• Primary languages: C/Objective-C header, Metal, Objective-C, Objective-C++, Swift.
• The verified tree contains 6 project/configuration file(s) and 19 source declaration(s).

Overall architecture

flowchart LR
    N1["AppDelegate"]
    N2["CameraViewController"]
    N3["FilterRenderer"]
    N4["CoreVideo / CoreMedia APIs"]
    N1 --> N2
    N2 --> N3
    N3 --> N4

Reference code

TrueDepthStreamer/AppDelegate.swift:10 — architecture anchor

@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
    var window: UIWindow?
}

Interpretation

The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into AVFoundation.

Ownership and state

classDiagram
    BGRAPixel *-- UInt8 : blue
    BGRAPixel *-- UInt8 : green
    BGRAPixel *-- UInt8 : red
    BGRAPixel *-- UInt8 : alpha

Ownership evidence

TrueDepthStreamer/DepthToJETConverter.swift:13 — stored dependency or nearest verified ownership anchor

struct BGRAPixel {
    var blue: UInt8 = 0
    var green: UInt8 = 0
    var red: UInt8 = 0
    var alpha: UInt8 = 0
}

Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.

Concurrency, scheduling, and thread safety

Evidence limit: actor isolation, async/await, or Task creation does not by itself prove background-thread execution; Sendable conformance alone does not prove thread-safe mutation.

@MainActor/MainActor.run, DispatchQueue.main, and RunLoop.main are reported as distinct isolation, queue, and event-loop mechanisms. A plain Task is kept separate from Task.detached; neither is labeled as a background thread.

Reference code

TrueDepthStreamer/CameraViewController.swift:46 — representative execution boundary

@available(iOS 11.1, *)
class CameraViewController: UIViewController, AVCaptureDataOutputSynchronizerDelegate {
    // ...
    private let sessionQueue = DispatchQueue(label: "session queue", attributes: [], autoreleaseFrequency: .workItem)
    // ...
}

State propagation, frameworks, and dependencies

Evidence limit: an import proves a source-level compilation dependency at the cited line; it does not prove runtime use, architectural adoption, or whether a Swift package is a direct application dependency.

receive(on:) describes downstream delivery scheduling, while subscribe(on:) describes upstream subscription/request/cancel scheduling. An import Combine alone establishes neither behavior nor a Store, reducer, Redux, or other application architecture.

Class and protocol design

TrueDepthStreamer/FilterRenderer.swift:10 — representative type boundary

protocol FilterRenderer: AnyObject {
    // ...
    var description: String { get }
    // ...
}

The source explicitly defines local protocol relationships: DepthToJETConverter → FilterRenderer.

Access control

Reference code

TrueDepthStreamer/CameraViewController.swift:39 — representative boundary

@available(iOS 11.1, *)
class CameraViewController: UIViewController, AVCaptureDataOutputSynchronizerDelegate {
    // ...
    private var setupResult: SessionSetupResult = .success
    // ...
}

Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.

Logic ownership and placement

Design patterns

Naming conventions

• Types: Controller: CameraViewController; Converter: DepthToJETConverter; Delegate: AppDelegate; Renderer: FilterRenderer; View: PointCloudMetalView, PreviewMetalView.
• Protocols: FilterRenderer.
• Methods: wave, fillJetTable, getColorTable, allocateOutputBufferPool, prepare, reset, render, makeTextureFromCVPixelBuffer.
• Files: TrueDepthStreamer/DepthToJETConverter.swift, TrueDepthStreamer/AppDelegate.swift, TrueDepthStreamer/CameraViewController.swift, TrueDepthStreamer/PreviewMetalView.swift, TrueDepthStreamer/FilterRenderer.swift, TrueDepthStreamer/PointCloud/PointCloudMetalView.h.

Architecture takeaways

• AppDelegate is the main source-visible entry or composition anchor for this sample.
• Framework work reaches CoreVideo, CoreMedia, Metal, MetalKit through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
• Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
• Access-control conclusions separate verified language visibility from the likely design rationale.
• Local protocol relationships provide an explicit substitution boundary.

Source map

• Official Apple documentation