Sample CodeiOS, iPadOS, Mac CatalystReviewed 2026-07-21View on Apple Developer

Tracking Multiple Objects or Rectangles in Video

At a glance

Item Summary
Purpose Apply Vision algorithms to track objects or rectangles throughout a video.
App architecture A Swift sample with the source-visible chain AppDelegateAssetsViewControllerVisionTrackerProcessorVision APIs.
Main patterns View-controller organization, Protocol-oriented abstraction, Delegate or data-source callbacks
Project style 7 scanned source file(s) across Swift, organized around ranked entry, type, and file boundaries.
Execution model Source-visible boundaries: DispatchQueue.main.async, DispatchQueue(label:); none alone proves a background thread.
State/event model No structured observation or publisher-scheduling marker indexed.
Key frameworks/packages UIKit, AVFoundation, Foundation, Vision, Darwin; these are source dependencies, not architecture labels.

Project structure

Source bundle/
├── VisionObjectTrack/
│   ├── AssetsViewController.swift
│   ├── AppDelegate.swift
│   ├── VisionTrackerProcessor.swift
│   ├── TrackingViewController.swift
│   ├── CommonTypes.swift
│   ├── TrackingImageView.swift
│   ├── VideoReader.swift
│   └── Base.lproj/
│       ├── LaunchScreen.storyboard
│       └── Main.storyboard
├── Configuration/
│   └── SampleCode.xcconfig
└── VisionObjectTrack.xcodeproj/
    ├── .xcodesamplecode.plist
    └── project.pbxproj

Structure observations

  • Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
  • Primary languages: Swift.
  • The verified tree contains 6 project/configuration file(s) and 16 source declaration(s).

Overall architecture

Reference code

VisionObjectTrack/AppDelegate.swift:10 — architecture anchor

@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
    var window: UIWindow?
}

Interpretation

The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into Vision.

Ownership and state

Ownership evidence

VisionObjectTrack/AssetsViewController.swift:15 — stored dependency or nearest verified ownership anchor

class AssetsViewControllerCell: UICollectionViewCell {
    // ...
    var representedAssetIdentifier: String = ""

    // ...
}
Owner Object or state Relationship Mutation authority
var String (representedAssetIdentifier) owns value state App/module collaborators
var UIImageView (imageView) holds a non-owning reference The referenced object’s lifecycle is owned elsewhere
var PHFetchResult (assets) stores or receives App/module collaborators
AppDelegate UIWindow (window) stores or receives App/module collaborators

Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.

Concurrency, scheduling, and thread safety

Evidence limit: actor isolation, async/await, or Task creation does not by itself prove background-thread execution; Sendable conformance alone does not prove thread-safe mutation.

Concern Source mechanism Verified placement or handoff Evidence
Queue scheduling DispatchQueue.main.async The source addresses the main dispatch queue. VisionObjectTrack/AssetsViewController.swift:32
Queue scheduling DispatchQueue(label:) The source constructs a dispatch queue; its label alone does not prove a thread. VisionObjectTrack/TrackingViewController.swift:36

@MainActor/MainActor.run, DispatchQueue.main, and RunLoop.main are reported as distinct isolation, queue, and event-loop mechanisms. A plain Task is kept separate from Task.detached; neither is labeled as a background thread.

Reference code

VisionObjectTrack/AssetsViewController.swift:32 — representative execution boundary

                DispatchQueue.main.async {
                    self.loadAssetsFromLibrary()
                }

State propagation, frameworks, and dependencies

Evidence limit: an import proves a source-level compilation dependency at the cited line; it does not prove runtime use, architectural adoption, or whether a Swift package is a direct application dependency.

Category Mechanism or module Verified role Evidence
Source import UIKit The cited file imports this module; runtime use and architectural role are not inferred. VisionObjectTrack/AppDelegate.swift:8
Source import AVFoundation The cited file imports this module; runtime use and architectural role are not inferred. VisionObjectTrack/TrackingViewController.swift:8
Source import Foundation The cited file imports this module; runtime use and architectural role are not inferred. VisionObjectTrack/CommonTypes.swift:8
Source import Vision The cited file imports this module; runtime use and architectural role are not inferred. VisionObjectTrack/CommonTypes.swift:10
Source import Darwin The cited file imports this module; runtime use and architectural role are not inferred. VisionObjectTrack/VideoReader.swift:10
Source import Photos The cited file imports this module; runtime use and architectural role are not inferred. VisionObjectTrack/AssetsViewController.swift:9

receive(on:) describes downstream delivery scheduling, while subscribe(on:) describes upstream subscription/request/cancel scheduling. An import Combine alone establishes neither behavior nor a Store, reducer, Redux, or other application architecture.

Class and protocol design

VisionObjectTrack/VisionTrackerProcessor.swift:19 — representative type boundary

protocol VisionTrackerProcessorDelegate: AnyObject {
    func displayFrame(_ frame: CVPixelBuffer?, withAffineTransform transform: CGAffineTransform, rects: [TrackedPolyRect]?)
    func displayFrameCounter(_ frame: Int)
    func didFinifshTracking()
}
Type Responsibility Depends on or conforms to
AppDelegate Receives callback-driven events UIResponder, UIApplicationDelegate
VisionTrackerProcessorDelegate Defines a capability or collaboration contract AnyObject
AssetsViewController View lifecycle, callbacks, and feature coordination UICollectionViewController
VisionTrackerProcessor Owns a feature processing stage Concrete collaborators/imported frameworks
TrackingViewController View lifecycle, callbacks, and feature coordination UIViewController
TrackingImageView User-interface presentation and input forwarding UIView
AssetsViewControllerCell Owns feature behavior and collaborator lifecycle UICollectionViewCell
var Owns feature behavior and collaborator lifecycle Concrete collaborators/imported frameworks
var Owns feature behavior and collaborator lifecycle Concrete collaborators/imported frameworks
VisionTrackerProcessorError Represents feature failure conditions Error

The source explicitly defines local protocol relationships: TrackingViewControllerVisionTrackerProcessorDelegate.

Access control

Symbol Access Verified effect Likely rationale
loadAssetsFromLibrary (VisionObjectTrack/AssetsViewController.swift:48) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: hide an implementation step that is not part of the collaboration surface.
recalculateItemSize (VisionObjectTrack/AssetsViewController.swift:61) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: hide an implementation step that is not part of the collaboration surface.
asset (VisionObjectTrack/AssetsViewController.swift:79) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: hide an implementation step that is not part of the collaboration surface.
scaleImage (VisionObjectTrack/TrackingImageView.swift:106) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: hide an implementation step that is not part of the collaboration surface.

Reference code

VisionObjectTrack/AssetsViewController.swift:48 — representative boundary

    private func loadAssetsFromLibrary() {
        let assetsOptions = PHFetchOptions()
        // ...
    }

Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.

Logic ownership and placement

Logic Owning type or file Placement rationale
View lifecycle, callbacks, and feature coordination AssetsViewController, TrackingViewController The source’s Controller suffix makes this role explicit.
Receives callback-driven events AppDelegate, VisionTrackerProcessorDelegate The source’s Delegate suffix makes this role explicit.
Owns a feature processing stage VisionTrackerProcessor The source’s Processor suffix makes this role explicit.
User-interface presentation and input forwarding TrackingImageView The source’s View suffix makes this role explicit.

Design patterns

Pattern Source evidence Purpose or tradeoff
View-controller organization VisionObjectTrack/AssetsViewController.swift:20 A controller is the verified coordination boundary; this is MVC-style only where a separate model is present.
Protocol-oriented abstraction VisionObjectTrack/TrackingViewController.swift:246 A local protocol and concrete conformance create an explicit capability boundary.
Delegate or data-source callbacks VisionObjectTrack/AppDelegate.swift:11 Callback protocols invert event delivery back into the sample’s owner.

Naming conventions

  • Types: Controller: AssetsViewController, TrackingViewController; Delegate: AppDelegate, VisionTrackerProcessorDelegate; Processor: VisionTrackerProcessor; View: TrackingImageView.
  • Protocols: VisionTrackerProcessorDelegate.
  • Methods: viewDidLoad, viewDidLayoutSubviews, loadAssetsFromLibrary, recalculateItemSize, asset, prepare, numberOfSections, collectionView.
  • Files: VisionObjectTrack/AssetsViewController.swift, VisionObjectTrack/AppDelegate.swift, VisionObjectTrack/VisionTrackerProcessor.swift, VisionObjectTrack/TrackingViewController.swift, VisionObjectTrack/TrackingImageView.swift, VisionObjectTrack/VideoReader.swift.

Architecture takeaways

  • AppDelegate is the main source-visible entry or composition anchor for this sample.
  • Framework work reaches UIKit, AVFoundation, Vision, Darwin through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
  • Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
  • Access-control conclusions separate verified language visibility from the likely design rationale.
  • Local protocol relationships provide an explicit substitution boundary.

Source map

Source file Relevant symbols
VisionObjectTrack/AppDelegate.swift Cited implementation, UIKit, AppDelegate
VisionObjectTrack/AssetsViewController.swift Cited implementation, AssetsViewController, DispatchQueue.main.async, Photos, AssetsViewControllerCell, var
VisionObjectTrack/VisionTrackerProcessor.swift VisionTrackerProcessorDelegate, VisionTrackerProcessorError, VisionTrackerProcessor
VisionObjectTrack/TrackingImageView.swift Cited implementation, TrackingImageView
VisionObjectTrack/TrackingViewController.swift Cited implementation, DispatchQueue(label:), AVFoundation, TrackingViewController, State
VisionObjectTrack/CommonTypes.swift Foundation, Vision, TrackedObjectType, TrackedPolyRectStyle, TrackedObjectsPalette, TrackedPolyRect
VisionObjectTrack/VideoReader.swift Darwin, VideoReader