Sample CodeiOS, iPadOS, Mac CatalystReviewed 2026-07-21View on Apple Developer

Tracking Multiple Objects or Rectangles in Video

At a glance

Item Summary
Purpose Apply Vision algorithms to track objects or rectangles throughout a video.
App architecture A Swift sample with the source-visible chain AppDelegateAssetsViewControllerVisionTrackerProcessorVision APIs.
Main patterns View-controller organization, Protocol-oriented abstraction, Delegate or data-source callbacks
Project style 7 scanned source file(s) across Swift, organized around ranked entry, type, and file boundaries.

Project structure

Source bundle/
├── VisionObjectTrack/
│   ├── AssetsViewController.swift
│   ├── AppDelegate.swift
│   ├── VisionTrackerProcessor.swift
│   ├── TrackingViewController.swift
│   ├── CommonTypes.swift
│   ├── TrackingImageView.swift
│   ├── VideoReader.swift
│   └── Base.lproj/
│       ├── LaunchScreen.storyboard
│       └── Main.storyboard
├── Configuration/
│   └── SampleCode.xcconfig
└── VisionObjectTrack.xcodeproj/
    ├── .xcodesamplecode.plist
    └── project.pbxproj

Structure observations

  • Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
  • Primary languages: Swift.
  • The verified tree contains 6 project/configuration file(s) and 16 source declaration(s).

Overall architecture

Reference code

VisionObjectTrack/AppDelegate.swift:10 — architecture anchor

@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
    var window: UIWindow?
}

Interpretation

The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into Vision.

Ownership and state

Ownership evidence

VisionObjectTrack/AssetsViewController.swift:11 — cell state and controller-owned fetch result

class AssetsViewControllerCell: UICollectionViewCell {
    var representedAssetIdentifier: String = ""
    
    @IBOutlet weak var imageView: UIImageView!
}

class AssetsViewController: UICollectionViewController {
    // ...
    var assets: PHFetchResult<PHAsset>?
}
Owner Object or state Relationship Mutation authority
AssetsViewControllerCell String (representedAssetIdentifier) owns reuse identity state AssetsViewController assigns it while configuring each reused cell.
AssetsViewControllerCell UIImageView (imageView) holds a non-owning outlet The storyboard-created view hierarchy owns the image view; the cell keeps a weak reference.
AssetsViewController PHFetchResult (assets) stores the Photos query result loadAssetsFromLibrary() replaces it after fetching video assets.
AppDelegate UIWindow (window) stores or receives App/module collaborators

Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.

Class and protocol design

VisionObjectTrack/VisionTrackerProcessor.swift:19 — representative type boundary

protocol VisionTrackerProcessorDelegate: AnyObject {
    func displayFrame(_ frame: CVPixelBuffer?, withAffineTransform transform: CGAffineTransform, rects: [TrackedPolyRect]?)
    func displayFrameCounter(_ frame: Int)
    func didFinifshTracking()
}
Type Responsibility Depends on or conforms to
AppDelegate Receives callback-driven events UIResponder, UIApplicationDelegate
VisionTrackerProcessorDelegate Defines a capability or collaboration contract AnyObject
AssetsViewController View lifecycle, callbacks, and feature coordination UICollectionViewController
VisionTrackerProcessor Owns a feature processing stage Concrete collaborators/imported frameworks
TrackingViewController View lifecycle, callbacks, and feature coordination UIViewController
TrackingImageView User-interface presentation and input forwarding UIView
AssetsViewControllerCell Owns feature behavior and collaborator lifecycle UICollectionViewCell
VisionTrackerProcessorError Represents feature failure conditions Error

The source explicitly defines local protocol relationships: TrackingViewControllerVisionTrackerProcessorDelegate.

Access control

Symbol Access Verified effect Likely rationale
loadAssetsFromLibrary (VisionObjectTrack/AssetsViewController.swift:48) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: hide an implementation step that is not part of the collaboration surface.
recalculateItemSize (VisionObjectTrack/AssetsViewController.swift:61) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: hide an implementation step that is not part of the collaboration surface.
asset (VisionObjectTrack/AssetsViewController.swift:79) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: hide an implementation step that is not part of the collaboration surface.
scaleImage (VisionObjectTrack/TrackingImageView.swift:106) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: hide an implementation step that is not part of the collaboration surface.

Reference code

VisionObjectTrack/AssetsViewController.swift:48 — representative boundary

    private func loadAssetsFromLibrary() {
        // ...
    }

Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.

Logic ownership and placement

Logic Owning type or file Placement rationale
View lifecycle, callbacks, and feature coordination AssetsViewController, TrackingViewController The source’s Controller suffix makes this role explicit.
Receives callback-driven events AppDelegate, VisionTrackerProcessorDelegate The source’s Delegate suffix makes this role explicit.
Owns a feature processing stage VisionTrackerProcessor The source’s Processor suffix makes this role explicit.
User-interface presentation and input forwarding TrackingImageView The source’s View suffix makes this role explicit.

Design patterns

Pattern Source evidence Purpose or tradeoff
View-controller organization VisionObjectTrack/AssetsViewController.swift:20 A controller is the verified coordination boundary; this is MVC-style only where a separate model is present.
Protocol-oriented abstraction VisionObjectTrack/TrackingViewController.swift:246 A local protocol and concrete conformance create an explicit capability boundary.
Delegate or data-source callbacks VisionObjectTrack/AppDelegate.swift:11 Callback protocols invert event delivery back into the sample’s owner.

Naming conventions

  • Types: Controller: AssetsViewController, TrackingViewController; Delegate: AppDelegate, VisionTrackerProcessorDelegate; Processor: VisionTrackerProcessor; View: TrackingImageView.
  • Protocols: VisionTrackerProcessorDelegate.
  • Methods: viewDidLoad, viewDidLayoutSubviews, loadAssetsFromLibrary, recalculateItemSize, asset, prepare, numberOfSections, collectionView.
  • Files: VisionObjectTrack/AssetsViewController.swift, VisionObjectTrack/AppDelegate.swift, VisionObjectTrack/VisionTrackerProcessor.swift, VisionObjectTrack/TrackingViewController.swift, VisionObjectTrack/TrackingImageView.swift, VisionObjectTrack/VideoReader.swift.

Architecture takeaways

  • AppDelegate is the main source-visible entry or composition anchor for this sample.
  • Framework work reaches UIKit, AVFoundation, Vision, Darwin through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
  • Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
  • Access-control conclusions separate verified language visibility from the likely design rationale.
  • Local protocol relationships provide an explicit substitution boundary.

Source map

Source file Relevant symbols
VisionObjectTrack/AssetsViewController.swift AssetsViewControllerCell, AssetsViewController
VisionObjectTrack/AppDelegate.swift AppDelegate
VisionObjectTrack/VisionTrackerProcessor.swift VisionTrackerProcessorError, VisionTrackerProcessorDelegate, VisionTrackerProcessor
VisionObjectTrack/TrackingViewController.swift TrackingViewController, State
VisionObjectTrack/CommonTypes.swift TrackedObjectType, TrackedPolyRectStyle, TrackedObjectsPalette, TrackedPolyRect
VisionObjectTrack/TrackingImageView.swift TrackingImageView
VisionObjectTrack/VideoReader.swift VideoReader