Counting human body action repetitions in a live video feed
At a glance
| Item | Summary |
|---|---|
| Purpose | Use Create ML Components to analyze a series of video frames and count a person’s repetitive or periodic body movements. |
| App architecture | A Swift sample with the source-visible chain MyApp → ContentView → ViewModel → CreateMLComponents APIs. |
| Main patterns | Model-View-ViewModel, Publisher-backed observable state |
| Project style | 11 scanned source file(s) across Swift, organized around ranked entry, type, and file boundaries. |
| Execution model | Source-visible boundaries: async declaration or closure, Task, @MainActor; none alone proves a background thread. |
| State/event model | Source-visible mechanisms: ObservableObject, @Published, SwiftUI state property wrapper. |
| Key frameworks/packages | SwiftUI, CreateMLComponents, AsyncAlgorithms; these are source dependencies, not architecture labels. |
Project structure
Source bundle/
├── CountMyActions/
│ ├── App/
│ │ ├── MyApp.swift
│ │ └── ContentView.swift
│ ├── Model/
│ │ └── ViewModel.swift
│ ├── Views/
│ │ ├── CameraView.swift
│ │ ├── CameraWithPosesAndOverlaysView.swift
│ │ ├── OverlayView.swift
│ │ └── PosesView.swift
│ ├── CountingPipeline/
│ │ └── ActionCounter.swift
│ └── DrawPose/
│ ├── Connection.swift
│ ├── Joint.swift
│ └── Pose.swift
└── Configuration/
└── SampleCode.xcconfig
Structure observations
- Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
- Primary languages: Swift.
- The verified tree contains 5 project/configuration file(s) and 9 source declaration(s).
Overall architecture
flowchart LR
N1["MyApp"]
N2["ContentView"]
N3["ViewModel"]
N4["CreateMLComponents APIs"]
N1 --> N2
N2 --> N3
N3 --> N4
Reference code
CountMyActions/App/MyApp.swift:10 — architecture anchor
@main
struct MyApp: App {
var body: some Scene {
WindowGroup {
ContentView()
}
}
}Interpretation
The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into Create ML Components.
Ownership and state
classDiagram
ViewModel o-- Pose : liveCameraImageAndPoses
ViewModel *-- Float : uiCount
ViewModel o-- Task : displayCameraTask
ViewModel o-- Task : predictionTask
Ownership evidence
CountMyActions/Model/ViewModel.swift:15 — stored dependency or nearest verified ownership anchor
class ViewModel: ObservableObject {
// ...
@Published var liveCameraImageAndPoses: (image: CGImage, poses: [Pose])?
// ...
}| Owner | Object or state | Relationship | Mutation authority |
|---|---|---|---|
ViewModel |
Pose (liveCameraImageAndPoses) |
stores or receives | App/module collaborators |
ViewModel |
Float (uiCount) |
owns value state | App/module collaborators |
ViewModel |
Task (displayCameraTask) |
stores or receives | Owning lexical scope |
ViewModel |
Task (predictionTask) |
stores or receives | Owning lexical scope |
Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.
Concurrency, scheduling, and thread safety
Evidence limit: actor isolation, async/await, or Task creation does not by itself prove background-thread execution; Sendable conformance alone does not prove thread-safe mutation.
| Concern | Source mechanism | Verified placement or handoff | Evidence |
|---|---|---|---|
| Suspension boundary | async declaration or closure |
The source declares or crosses an asynchronous boundary; it does not by itself establish background execution. | CountMyActions/CountingPipeline/ActionCounter.swift:36 |
| Task creation | Task |
The source creates an unstructured task; surrounding context determines inherited actor isolation. | CountMyActions/Model/ViewModel.swift:79 |
| Main isolation | @MainActor |
The cited annotation marks its attached declaration or closure as main-actor isolated. | CountMyActions/Model/ViewModel.swift:168 |
@MainActor/MainActor.run, DispatchQueue.main, and RunLoop.main are reported as distinct isolation, queue, and event-loop mechanisms. A plain Task is kept separate from Task.detached; neither is labeled as a background thread.
Reference code
CountMyActions/CountingPipeline/ActionCounter.swift:36 — representative execution boundary
func count(_ poseStream: AnyTemporalSequence<[Pose]>) async throws -> HumanBodyActionCounter.CumulativeSumSequence {
return try await pipeline(poseStream)
}State propagation, frameworks, and dependencies
Evidence limit: an import proves a source-level compilation dependency at the cited line; it does not prove runtime use, architectural adoption, or whether a Swift package is a direct application dependency.
| Category | Mechanism or module | Verified role | Evidence |
|---|---|---|---|
| State propagation | ObservableObject |
ObservableObject supplies an observation contract. | CountMyActions/Model/ViewModel.swift:12 |
| State propagation | @Published |
A published property can emit owner-controlled changes. | CountMyActions/Model/ViewModel.swift:15 |
| State propagation | SwiftUI state property wrapper |
A SwiftUI property wrapper supplies or observes UI state. | CountMyActions/Views/CameraWithPosesAndOverlaysView.swift:12 |
| Source import | SwiftUI |
The cited file imports this module; runtime use and architectural role are not inferred. | CountMyActions/App/ContentView.swift:8 |
| Source import | CreateMLComponents |
The cited file imports this module; runtime use and architectural role are not inferred. | CountMyActions/CountingPipeline/ActionCounter.swift:8 |
| Source import | AsyncAlgorithms |
The cited file imports this module; runtime use and architectural role are not inferred. | CountMyActions/Model/ViewModel.swift:10 |
receive(on:) describes downstream delivery scheduling, while subscribe(on:) describes upstream subscription/request/cancel scheduling. An import Combine alone establishes neither behavior nor a Store, reducer, Redux, or other application architecture.
Class and protocol design
CountMyActions/App/MyApp.swift:11 — representative type boundary
@main
struct MyApp: App {
// ...
ContentView()
// ...
}| Type | Responsibility | Depends on or conforms to |
|---|---|---|
MyApp |
Application entry and top-level composition | App |
ViewModel |
UI-facing state and feature coordination | ObservableObject |
CameraView |
User-interface presentation and input forwarding | View |
CameraWithPosesAndOverlaysView |
User-interface presentation and input forwarding | View |
OverlayView |
User-interface presentation and input forwarding | View |
PosesView |
User-interface presentation and input forwarding | View |
ContentView |
User-interface presentation and input forwarding | View |
ActionCounter |
Represents a feature value or composable behavior | Concrete collaborators/imported frameworks |
Connection |
Represents a feature value or composable behavior | Equatable |
No local protocol conformance is claimed as protocol-oriented design; external framework conformances are listed only as dependencies.
Access control
| Symbol | Access | Verified effect | Likely rationale |
|---|---|---|---|
point1 (CountMyActions/DrawPose/Connection.swift:27) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
point2 (CountMyActions/DrawPose/Connection.swift:30) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
drawingScale (CountMyActions/DrawPose/Pose.swift:42) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
displayCameraTask (CountMyActions/Model/ViewModel.swift:20) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
Reference code
CountMyActions/DrawPose/Connection.swift:27 — representative boundary
struct Connection: Equatable {
// ...
private let point1: CGPoint
// ...
}Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.
Logic ownership and placement
| Logic | Owning type or file | Placement rationale |
|---|---|---|
| Application entry and top-level composition | MyApp |
The source’s App suffix makes this role explicit. |
| User-interface presentation and input forwarding | CameraView, CameraWithPosesAndOverlaysView, ContentView, OverlayView |
The source’s View suffix makes this role explicit. |
| UI-facing state and feature coordination | ViewModel |
The source’s ViewModel suffix makes this role explicit. |
Design patterns
| Pattern | Source evidence | Purpose or tradeoff |
|---|---|---|
| Model-View-ViewModel | CountMyActions/Model/ViewModel.swift:12 |
Role-named view models keep UI-facing state or coordination outside view declarations. |
| Publisher-backed observable state | CountMyActions/Model/ViewModel.swift:15 |
Published properties notify observers while mutation remains with the state object. |
Main application flow
sequenceDiagram
participant ViewModel
participant VideoReader
participant poseExtractor
participant poseStream
ViewModel->>VideoReader: readCamera()
ViewModel-->>ViewModel: frame() stream
ViewModel->>poseExtractor: applied()
ViewModel->>poseStream: send()
ViewModel->>ViewModel: display()
Reference code
CountMyActions/Model/ViewModel.swift:107 — displayPoseInCamera()
func displayPoseInCamera() async throws {
// Start reading the camera.
let frameSequence = try await VideoReader.readCamera(
configuration: configuration
)
var lastTime = CFAbsoluteTimeGetCurrent()
for try await frame in frameSequence {
if Task.isCancelled {
return
}
// Extract poses in every frame.
let poses = try await poseExtractor.applied(to: frame.feature)
// Send poses into another pose stream for additional consumers.
await poseStream.send(TemporalFeature(id: frame.id, feature: poses))
// Calculate poses from the image frame and display both.
if let cgImage = CIContext()
.createCGImage(frame.feature, from: frame.feature.extent) {
await display(image: cgImage, poses: poses)
}
// Frame rate debug information.
print(String(format: "Frame rate %2.2f fps", 1 / (CFAbsoluteTimeGetCurrent() - lastTime)))
lastTime = CFAbsoluteTimeGetCurrent()
}
}Naming conventions
- Types: App: MyApp; View: CameraView, CameraWithPosesAndOverlaysView, ContentView, OverlayView, PosesView; ViewModel: ViewModel.
- Protocols: no local protocol declaration in the scanned source.
- Methods:
initialize,onCameraButtonTapped,toggleCameraSelection,startVideoProcessingPipeline,displayPoseInCamera,predictCount,display,bubbleBackground. - Files:
CountMyActions/App/MyApp.swift,CountMyActions/Model/ViewModel.swift,CountMyActions/Views/CameraView.swift,CountMyActions/Views/CameraWithPosesAndOverlaysView.swift,CountMyActions/Views/OverlayView.swift,CountMyActions/Views/PosesView.swift.
Architecture takeaways
MyAppis the main source-visible entry or composition anchor for this sample.- Framework work reaches SwiftUI, CreateMLComponents, AsyncAlgorithms through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
- Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
- Access-control conclusions separate verified language visibility from the likely design rationale.
- The source does not justify labeling the design protocol-oriented.
Source map
| Source file | Relevant symbols |
|---|---|
CountMyActions/App/MyApp.swift |
Cited implementation, MyApp |
CountMyActions/Model/ViewModel.swift |
Cited implementation, ViewModel, Task, @MainActor, ObservableObject, @Published, AsyncAlgorithms |
CountMyActions/DrawPose/Connection.swift |
Cited implementation, Connection |
CountMyActions/DrawPose/Pose.swift |
Cited implementation, Feature implementation |
CountMyActions/CountingPipeline/ActionCounter.swift |
async declaration or closure, CreateMLComponents, ActionCounter |
CountMyActions/Views/CameraWithPosesAndOverlaysView.swift |
SwiftUI state property wrapper, CameraWithPosesAndOverlaysView, CameraWithOverlaysView_Previews |
CountMyActions/App/ContentView.swift |
SwiftUI, ContentView |
CountMyActions/Views/CameraView.swift |
CameraView, CameraView_Previews |
CountMyActions/Views/OverlayView.swift |
OverlayView, OverlayView_Previews |
CountMyActions/Views/PosesView.swift |
PosesView, PosesView_Previews |
CountMyActions/DrawPose/Joint.swift |
Feature implementation |