Detecting human actions in a live video feed
At a glance
| Item | Summary |
|---|---|
| Purpose | Identify body movements by sending a person’s pose data from a series of video frames to an action-classification model. |
| App architecture | A Swift sample with the source-visible chain AppDelegate → MainViewController → UIKit / AVFoundation APIs. |
| Main patterns | View-controller organization, Protocol-oriented abstraction, Delegate or data-source callbacks |
| Project style | 19 scanned source file(s) across Swift, organized around ranked entry, type, and file boundaries. |
| Execution model | Source-visible boundaries: RunLoop, DispatchQueue(label:), DispatchQueue.main.async, DispatchQueue.global.async; none alone proves a background thread. |
| State/event model | Source-visible mechanisms: AnyCancellable. |
| Key frameworks/packages | UIKit, AVFoundation, CoreML, Vision, Combine; these are source dependencies, not architecture labels. |
Project structure
Source bundle/
└── GuessMyExercise/
├── App/
│ └── AppDelegate.swift
├── Views/
│ ├── SummaryViewController.swift
│ └── MainViewController.swift
├── Action Classifier/
│ ├── ActionPrediction.swift
│ ├── ExerciseClassifier+Label.swift
│ └── ExerciseClassifier+FrameRate.swift
├── Video Capture/
│ └── VideoCapture.swift
├── Video Processing Chain/
│ └── VideoProcessingChain.swift
├── Pose/
│ ├── Pose+Connection.swift
│ ├── Pose+Landmark.swift
│ └── Pose.swift
└── Utility/
└── PerformanceReporter.swift
Structure observations
- Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
- Primary languages: Swift.
- The verified tree contains 7 project/configuration file(s) and 15 source declaration(s).
Overall architecture
flowchart LR
N1["AppDelegate"]
N2["MainViewController"]
N3["UIKit / AVFoundation APIs"]
N1 --> N2
N2 --> N3
Reference code
GuessMyExercise/App/AppDelegate.swift:10 — architecture anchor
@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
var window: UIWindow?
func application(_ application: UIApplication,
didFinishLaunchingWithOptions launchOptions: [UIApplication.LaunchOptionsKey: Any]?) -> Bool {
return true
}
}Interpretation
The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into Create ML.
Ownership and state
classDiagram
AppDelegate o-- UIWindow : window
SummaryViewController o-- UITableView : tableView
SummaryViewController o-- Callback : dismissalClosure
SummaryTableViewCell o-- UILabel : actionLabel
Ownership evidence
GuessMyExercise/App/AppDelegate.swift:13 — stored dependency or nearest verified ownership anchor
@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
// ...
var window: UIWindow?
// ...
}| Owner | Object or state | Relationship | Mutation authority |
|---|---|---|---|
AppDelegate |
UIWindow (window) |
stores or receives | App/module collaborators |
SummaryViewController |
UITableView (tableView) |
holds a non-owning reference | The referenced object’s lifecycle is owned elsewhere |
SummaryViewController |
Callback (dismissalClosure) |
stores a callback | App/module collaborators |
SummaryTableViewCell |
UILabel (actionLabel) |
holds a non-owning reference | The referenced object’s lifecycle is owned elsewhere |
Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.
Concurrency, scheduling, and thread safety
Evidence limit: actor isolation, async/await, or Task creation does not by itself prove background-thread execution; Sendable conformance alone does not prove thread-safe mutation.
| Concern | Source mechanism | Verified placement or handoff | Evidence |
|---|---|---|---|
| Run-loop scheduling | RunLoop |
The source refers to a run loop; the owning thread requires surrounding evidence. | GuessMyExercise/Utility/PerformanceReporter.swift:39 |
| Queue scheduling | DispatchQueue(label:) |
The source constructs a dispatch queue; its label alone does not prove a thread. | GuessMyExercise/Video Capture/VideoCapture.swift:71 |
| Queue scheduling | DispatchQueue.main.async |
The source addresses the main dispatch queue. | GuessMyExercise/Video Processing Chain/VideoProcessingChain.swift:197 |
| Queue scheduling | DispatchQueue.global.async |
The source addresses a global dispatch queue; no stable thread identity is implied. | GuessMyExercise/Views/MainViewController.swift:184 |
@MainActor/MainActor.run, DispatchQueue.main, and RunLoop.main are reported as distinct isolation, queue, and event-loop mechanisms. A plain Task is kept separate from Task.detached; neither is labeled as a background thread.
Reference code
GuessMyExercise/Utility/PerformanceReporter.swift:39 — representative execution boundary
class PerformanceReporter {
// ...
RunLoop.current.add(timer, forMode: .common)
// ...
}State propagation, frameworks, and dependencies
Evidence limit: an import proves a source-level compilation dependency at the cited line; it does not prove runtime use, architectural adoption, or whether a Swift package is a direct application dependency.
| Category | Mechanism or module | Verified role | Evidence |
|---|---|---|---|
| State propagation | AnyCancellable |
A cancellable value records subscription lifetime management. | GuessMyExercise/Video Processing Chain/VideoProcessingChain.swift:52 |
| Source import | UIKit |
The cited file imports this module; runtime use and architectural role are not inferred. | GuessMyExercise/App/AppDelegate.swift:8 |
| Source import | AVFoundation |
The cited file imports this module; runtime use and architectural role are not inferred. | GuessMyExercise/Video Capture/AVCaptureDevice+FrameRate.swift:8 |
| Source import | CoreML |
The cited file imports this module; runtime use and architectural role are not inferred. | GuessMyExercise/Action Classifier/ExerciseClassifier+FrameRate.swift:10 |
| Source import | Vision |
The cited file imports this module; runtime use and architectural role are not inferred. | GuessMyExercise/Pose/Pose+Landmark.swift:12 |
| Source import | Combine |
The cited file imports this module; runtime use and architectural role are not inferred. | GuessMyExercise/Video Capture/VideoCapture.swift:10 |
| Source import | CoreImage |
The cited file imports this module; runtime use and architectural role are not inferred. | GuessMyExercise/Video Processing Chain/VideoProcessingChain.swift:11 |
receive(on:) describes downstream delivery scheduling, while subscribe(on:) describes upstream subscription/request/cancel scheduling. An import Combine alone establishes neither behavior nor a Store, reducer, Redux, or other application architecture.
Class and protocol design
GuessMyExercise/Video Capture/VideoCapture.swift:16 — representative type boundary
protocol VideoCaptureDelegate: AnyObject {
/// Informs the delegate when the Video Capture creates a new publisher.
/// - Parameters:
/// - framePublisher: The new frame publisher.
func videoCapture(_ videoCapture: VideoCapture,
didCreate framePublisher: FramePublisher)
}| Type | Responsibility | Depends on or conforms to |
|---|---|---|
AppDelegate |
Receives callback-driven events | UIResponder, UIApplicationDelegate |
VideoCaptureDelegate |
Defines a capability or collaboration contract | AnyObject |
VideoProcessingChainDelegate |
Defines a capability or collaboration contract | AnyObject |
SummaryViewController |
View lifecycle, callbacks, and feature coordination | UIViewController |
MainViewController |
View lifecycle, callbacks, and feature coordination | UIViewController |
SummaryTableViewCell |
Owns feature behavior and collaborator lifecycle | UITableViewCell |
ActionPrediction |
Represents a feature value or composable behavior | Concrete collaborators/imported frameworks |
AppLabel |
Defines a closed set of feature states or choices | String |
VideoCapture |
Owns feature behavior and collaborator lifecycle | NSObject |
VideoProcessingChain |
Represents a feature value or composable behavior | Concrete collaborators/imported frameworks |
The source explicitly defines local protocol relationships: MainViewController → VideoCaptureDelegate, MainViewController → VideoProcessingChainDelegate.
Access control
| Symbol | Access | Verified effect | Likely rationale |
|---|---|---|---|
ActionPrediction (GuessMyExercise/Action Classifier/ActionPrediction.swift:63) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: hide an implementation step that is not part of the collaboration surface. |
point1 (GuessMyExercise/Pose/Pose+Connection.swift:32) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
point2 (GuessMyExercise/Pose/Pose+Connection.swift:35) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
zeroedMultiArrayWithShape (GuessMyExercise/Pose/Pose+Empty.swift:22) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: hide an implementation step that is not part of the collaboration surface. |
Reference code
GuessMyExercise/Action Classifier/ActionPrediction.swift:63 — representative boundary
private init(_ otherLabel: AppLabel) {
label = otherLabel.rawValue
confidence = nil
}Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.
Logic ownership and placement
| Logic | Owning type or file | Placement rationale |
|---|---|---|
| View lifecycle, callbacks, and feature coordination | MainViewController, SummaryViewController |
The source’s Controller suffix makes this role explicit. |
| Receives callback-driven events | AppDelegate, VideoCaptureDelegate, VideoProcessingChainDelegate |
The source’s Delegate suffix makes this role explicit. |
Design patterns
| Pattern | Source evidence | Purpose or tradeoff |
|---|---|---|
| View-controller organization | GuessMyExercise/Views/MainViewController.swift:12 |
A controller is the verified coordination boundary; this is MVC-style only where a separate model is present. |
| Protocol-oriented abstraction | GuessMyExercise/Views/MainViewController.swift:141 |
A local protocol and concrete conformance create an explicit capability boundary. |
| Delegate or data-source callbacks | GuessMyExercise/App/AppDelegate.swift:11 |
Callback protocols invert event delivery back into the sample’s owner. |
Naming conventions
- Types: Controller: MainViewController, SummaryViewController; Delegate: AppDelegate, VideoCaptureDelegate, VideoProcessingChainDelegate.
- Protocols:
VideoCaptureDelegate,VideoProcessingChainDelegate. - Methods:
application,viewDidLoad,viewDidDisappear,tableView,viewDidAppear,viewWillTransition,onCameraButtonTapped,onSummaryButtonTapped. - Files:
GuessMyExercise/App/AppDelegate.swift,GuessMyExercise/Views/SummaryViewController.swift,GuessMyExercise/Views/MainViewController.swift,GuessMyExercise/Action Classifier/ActionPrediction.swift,GuessMyExercise/Video Capture/VideoCapture.swift,GuessMyExercise/Video Processing Chain/VideoProcessingChain.swift.
Architecture takeaways
AppDelegateis the main source-visible entry or composition anchor for this sample.- Framework work reaches UIKit, AVFoundation, CoreML, Vision through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
- Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
- Access-control conclusions separate verified language visibility from the likely design rationale.
- Local protocol relationships provide an explicit substitution boundary.
Source map
| Source file | Relevant symbols |
|---|---|
GuessMyExercise/App/AppDelegate.swift |
Cited implementation, UIKit, AppDelegate |
GuessMyExercise/Video Capture/VideoCapture.swift |
VideoCaptureDelegate, DispatchQueue(label:), Combine, VideoCapture |
GuessMyExercise/Action Classifier/ActionPrediction.swift |
Cited implementation, ActionPrediction, AppLabel |
GuessMyExercise/Pose/Pose+Connection.swift |
Cited implementation, Connection |
GuessMyExercise/Pose/Pose+Empty.swift |
Cited implementation, Feature implementation |
GuessMyExercise/Views/MainViewController.swift |
MainViewController, Cited implementation, DispatchQueue.global.async |
GuessMyExercise/Utility/PerformanceReporter.swift |
RunLoop, PerformanceReporter |
GuessMyExercise/Video Processing Chain/VideoProcessingChain.swift |
DispatchQueue.main.async, AnyCancellable, CoreImage, VideoProcessingChainDelegate, VideoProcessingChain |
GuessMyExercise/Video Capture/AVCaptureDevice+FrameRate.swift |
AVFoundation, Feature implementation |
GuessMyExercise/Action Classifier/ExerciseClassifier+FrameRate.swift |
CoreML, Feature implementation |
GuessMyExercise/Pose/Pose+Landmark.swift |
Vision, Landmark |
GuessMyExercise/Views/SummaryViewController.swift |
SummaryViewController, SummaryTableViewCell |
GuessMyExercise/Action Classifier/ExerciseClassifier+Label.swift |
Label |
GuessMyExercise/Pose/Pose.swift |
Pose |
GuessMyExercise/Action Classifier/ExerciseClassifier+LabelCheck.swift |
Feature implementation |
GuessMyExercise/Action Classifier/ExerciseClassifier+PredictAction.swift |
Feature implementation |