Tracking Multiple Objects or Rectangles in Video
At a glance
| Item | Summary |
|---|---|
| Purpose | Apply Vision algorithms to track objects or rectangles throughout a video. |
| App architecture | A Swift sample with the source-visible chain AppDelegate → AssetsViewController → VisionTrackerProcessor → Vision APIs. |
| Main patterns | View-controller organization, Protocol-oriented abstraction, Delegate or data-source callbacks |
| Project style | 7 scanned source file(s) across Swift, organized around ranked entry, type, and file boundaries. |
| Execution model | Source-visible boundaries: DispatchQueue.main.async, DispatchQueue(label:); none alone proves a background thread. |
| State/event model | No structured observation or publisher-scheduling marker indexed. |
| Key frameworks/packages | UIKit, AVFoundation, Foundation, Vision, Darwin; these are source dependencies, not architecture labels. |
Project structure
Source bundle/
├── VisionObjectTrack/
│ ├── AssetsViewController.swift
│ ├── AppDelegate.swift
│ ├── VisionTrackerProcessor.swift
│ ├── TrackingViewController.swift
│ ├── CommonTypes.swift
│ ├── TrackingImageView.swift
│ ├── VideoReader.swift
│ └── Base.lproj/
│ ├── LaunchScreen.storyboard
│ └── Main.storyboard
├── Configuration/
│ └── SampleCode.xcconfig
└── VisionObjectTrack.xcodeproj/
├── .xcodesamplecode.plist
└── project.pbxproj
Structure observations
- Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
- Primary languages: Swift.
- The verified tree contains 6 project/configuration file(s) and 16 source declaration(s).
Overall architecture
flowchart LR
N1["AppDelegate"]
N2["AssetsViewController"]
N3["VisionTrackerProcessor"]
N4["Vision APIs"]
N1 --> N2
N2 --> N3
N3 --> N4
Reference code
VisionObjectTrack/AppDelegate.swift:10 — architecture anchor
@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
var window: UIWindow?
}Interpretation
The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into Vision.
Ownership and state
classDiagram
var *-- String : representedAssetIdentifier
var o-- UIImageView : imageView
var o-- PHFetchResult : assets
AppDelegate o-- UIWindow : window
Ownership evidence
VisionObjectTrack/AssetsViewController.swift:15 — stored dependency or nearest verified ownership anchor
class AssetsViewControllerCell: UICollectionViewCell {
// ...
var representedAssetIdentifier: String = ""
// ...
}| Owner | Object or state | Relationship | Mutation authority |
|---|---|---|---|
var |
String (representedAssetIdentifier) |
owns value state | App/module collaborators |
var |
UIImageView (imageView) |
holds a non-owning reference | The referenced object’s lifecycle is owned elsewhere |
var |
PHFetchResult (assets) |
stores or receives | App/module collaborators |
AppDelegate |
UIWindow (window) |
stores or receives | App/module collaborators |
Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.
Concurrency, scheduling, and thread safety
Evidence limit: actor isolation, async/await, or Task creation does not by itself prove background-thread execution; Sendable conformance alone does not prove thread-safe mutation.
| Concern | Source mechanism | Verified placement or handoff | Evidence |
|---|---|---|---|
| Queue scheduling | DispatchQueue.main.async |
The source addresses the main dispatch queue. | VisionObjectTrack/AssetsViewController.swift:32 |
| Queue scheduling | DispatchQueue(label:) |
The source constructs a dispatch queue; its label alone does not prove a thread. | VisionObjectTrack/TrackingViewController.swift:36 |
@MainActor/MainActor.run, DispatchQueue.main, and RunLoop.main are reported as distinct isolation, queue, and event-loop mechanisms. A plain Task is kept separate from Task.detached; neither is labeled as a background thread.
Reference code
VisionObjectTrack/AssetsViewController.swift:32 — representative execution boundary
DispatchQueue.main.async {
self.loadAssetsFromLibrary()
}State propagation, frameworks, and dependencies
Evidence limit: an import proves a source-level compilation dependency at the cited line; it does not prove runtime use, architectural adoption, or whether a Swift package is a direct application dependency.
| Category | Mechanism or module | Verified role | Evidence |
|---|---|---|---|
| Source import | UIKit |
The cited file imports this module; runtime use and architectural role are not inferred. | VisionObjectTrack/AppDelegate.swift:8 |
| Source import | AVFoundation |
The cited file imports this module; runtime use and architectural role are not inferred. | VisionObjectTrack/TrackingViewController.swift:8 |
| Source import | Foundation |
The cited file imports this module; runtime use and architectural role are not inferred. | VisionObjectTrack/CommonTypes.swift:8 |
| Source import | Vision |
The cited file imports this module; runtime use and architectural role are not inferred. | VisionObjectTrack/CommonTypes.swift:10 |
| Source import | Darwin |
The cited file imports this module; runtime use and architectural role are not inferred. | VisionObjectTrack/VideoReader.swift:10 |
| Source import | Photos |
The cited file imports this module; runtime use and architectural role are not inferred. | VisionObjectTrack/AssetsViewController.swift:9 |
receive(on:) describes downstream delivery scheduling, while subscribe(on:) describes upstream subscription/request/cancel scheduling. An import Combine alone establishes neither behavior nor a Store, reducer, Redux, or other application architecture.
Class and protocol design
VisionObjectTrack/VisionTrackerProcessor.swift:19 — representative type boundary
protocol VisionTrackerProcessorDelegate: AnyObject {
func displayFrame(_ frame: CVPixelBuffer?, withAffineTransform transform: CGAffineTransform, rects: [TrackedPolyRect]?)
func displayFrameCounter(_ frame: Int)
func didFinifshTracking()
}| Type | Responsibility | Depends on or conforms to |
|---|---|---|
AppDelegate |
Receives callback-driven events | UIResponder, UIApplicationDelegate |
VisionTrackerProcessorDelegate |
Defines a capability or collaboration contract | AnyObject |
AssetsViewController |
View lifecycle, callbacks, and feature coordination | UICollectionViewController |
VisionTrackerProcessor |
Owns a feature processing stage | Concrete collaborators/imported frameworks |
TrackingViewController |
View lifecycle, callbacks, and feature coordination | UIViewController |
TrackingImageView |
User-interface presentation and input forwarding | UIView |
AssetsViewControllerCell |
Owns feature behavior and collaborator lifecycle | UICollectionViewCell |
var |
Owns feature behavior and collaborator lifecycle | Concrete collaborators/imported frameworks |
var |
Owns feature behavior and collaborator lifecycle | Concrete collaborators/imported frameworks |
VisionTrackerProcessorError |
Represents feature failure conditions | Error |
The source explicitly defines local protocol relationships: TrackingViewController → VisionTrackerProcessorDelegate.
Access control
| Symbol | Access | Verified effect | Likely rationale |
|---|---|---|---|
loadAssetsFromLibrary (VisionObjectTrack/AssetsViewController.swift:48) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: hide an implementation step that is not part of the collaboration surface. |
recalculateItemSize (VisionObjectTrack/AssetsViewController.swift:61) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: hide an implementation step that is not part of the collaboration surface. |
asset (VisionObjectTrack/AssetsViewController.swift:79) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: hide an implementation step that is not part of the collaboration surface. |
scaleImage (VisionObjectTrack/TrackingImageView.swift:106) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: hide an implementation step that is not part of the collaboration surface. |
Reference code
VisionObjectTrack/AssetsViewController.swift:48 — representative boundary
private func loadAssetsFromLibrary() {
let assetsOptions = PHFetchOptions()
// ...
}Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.
Logic ownership and placement
| Logic | Owning type or file | Placement rationale |
|---|---|---|
| View lifecycle, callbacks, and feature coordination | AssetsViewController, TrackingViewController |
The source’s Controller suffix makes this role explicit. |
| Receives callback-driven events | AppDelegate, VisionTrackerProcessorDelegate |
The source’s Delegate suffix makes this role explicit. |
| Owns a feature processing stage | VisionTrackerProcessor |
The source’s Processor suffix makes this role explicit. |
| User-interface presentation and input forwarding | TrackingImageView |
The source’s View suffix makes this role explicit. |
Design patterns
| Pattern | Source evidence | Purpose or tradeoff |
|---|---|---|
| View-controller organization | VisionObjectTrack/AssetsViewController.swift:20 |
A controller is the verified coordination boundary; this is MVC-style only where a separate model is present. |
| Protocol-oriented abstraction | VisionObjectTrack/TrackingViewController.swift:246 |
A local protocol and concrete conformance create an explicit capability boundary. |
| Delegate or data-source callbacks | VisionObjectTrack/AppDelegate.swift:11 |
Callback protocols invert event delivery back into the sample’s owner. |
Naming conventions
- Types: Controller: AssetsViewController, TrackingViewController; Delegate: AppDelegate, VisionTrackerProcessorDelegate; Processor: VisionTrackerProcessor; View: TrackingImageView.
- Protocols:
VisionTrackerProcessorDelegate. - Methods:
viewDidLoad,viewDidLayoutSubviews,loadAssetsFromLibrary,recalculateItemSize,asset,prepare,numberOfSections,collectionView. - Files:
VisionObjectTrack/AssetsViewController.swift,VisionObjectTrack/AppDelegate.swift,VisionObjectTrack/VisionTrackerProcessor.swift,VisionObjectTrack/TrackingViewController.swift,VisionObjectTrack/TrackingImageView.swift,VisionObjectTrack/VideoReader.swift.
Architecture takeaways
AppDelegateis the main source-visible entry or composition anchor for this sample.- Framework work reaches UIKit, AVFoundation, Vision, Darwin through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
- Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
- Access-control conclusions separate verified language visibility from the likely design rationale.
- Local protocol relationships provide an explicit substitution boundary.
Source map
| Source file | Relevant symbols |
|---|---|
VisionObjectTrack/AppDelegate.swift |
Cited implementation, UIKit, AppDelegate |
VisionObjectTrack/AssetsViewController.swift |
Cited implementation, AssetsViewController, DispatchQueue.main.async, Photos, AssetsViewControllerCell, var |
VisionObjectTrack/VisionTrackerProcessor.swift |
VisionTrackerProcessorDelegate, VisionTrackerProcessorError, VisionTrackerProcessor |
VisionObjectTrack/TrackingImageView.swift |
Cited implementation, TrackingImageView |
VisionObjectTrack/TrackingViewController.swift |
Cited implementation, DispatchQueue(label:), AVFoundation, TrackingViewController, State |
VisionObjectTrack/CommonTypes.swift |
Foundation, Vision, TrackedObjectType, TrackedPolyRectStyle, TrackedObjectsPalette, TrackedPolyRect |
VisionObjectTrack/VideoReader.swift |
Darwin, VideoReader |