Debugging AVFoundation audio mixes, compositions, and video compositions
At a glance
| Item | Summary |
|---|---|
| Purpose | Resolve common problems when creating compositions, video compositions, and audio mixes. |
| App architecture | A Swift sample with the source-visible chain AppDelegate → PlayerViewController → AVFoundation APIs. |
| Main patterns | View-controller organization, Delegate or data-source callbacks |
| Project style | 8 scanned source file(s) across Swift, organized around ranked entry, type, and file boundaries. |
| Execution model | Source-visible boundaries: DispatchQueue(label:), DispatchQueue.main; none alone proves a background thread. |
| State/event model | No structured observation or publisher-scheduling marker indexed. |
| Key frameworks/packages | UIKit, AVFoundation, Foundation, AVKit; these are source dependencies, not architecture labels. |
Project structure
Source bundle/
├── AVCompositionDebugViewer/
│ ├── AppDelegate.swift
│ ├── DebugView/
│ │ ├── CompDebugView.swift
│ │ ├── CompDebugViewCAUtils.swift
│ │ └── CompDebugViewUtils.swift
│ ├── Editor/
│ │ ├── SimpleEditorUtils.swift
│ │ └── SimpleEditor.swift
│ ├── PlayerViewController.swift
│ ├── SceneDelegate.swift
│ └── Base.lproj/
│ ├── LaunchScreen.storyboard
│ └── Main.storyboard
└── AVCompositionDebugViewer.xcodeproj/
├── .xcodesamplecode.plist
└── project.pbxproj
Structure observations
- Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
- Primary languages: Swift.
- The verified tree contains 6 project/configuration file(s) and 11 source declaration(s).
Overall architecture
flowchart LR
N1["AppDelegate"]
N2["PlayerViewController"]
N3["AVFoundation APIs"]
N1 --> N2
N2 --> N3
Reference code
AVCompositionDebugViewer/AppDelegate.swift:10 — architecture anchor
@main
class AppDelegate: UIResponder, UIApplicationDelegate {
func application(_ application: UIApplication, didFinishLaunchingWithOptions launchOptions: [UIApplication.LaunchOptionsKey: Any]?) -> Bool {
return true
}
}Interpretation
The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into AVFoundation.
Ownership and state
classDiagram
CompositionTrackSegmentInfo *-- String : description
CompositionDebugView *-- CALayer : drawingLayer
CompositionDebugView *-- CMTimeMake : duration
CompositionDebugView *-- CGFloat : scaledDurationToWidth
Ownership evidence
AVCompositionDebugViewer/DebugView/CompDebugView.swift:30 — stored dependency or nearest verified ownership anchor
struct CompositionTrackSegmentInfo {
var timeRange = CMTimeRange.zero
var empty = true
var mediaType = AVMediaType.video
var description = String("")
}| Owner | Object or state | Relationship | Mutation authority |
|---|---|---|---|
CompositionTrackSegmentInfo |
String (description) |
owns value state | App/module collaborators |
CompositionDebugView |
CALayer (drawingLayer) |
creates and retains | Owning lexical scope |
CompositionDebugView |
CMTimeMake (duration) |
creates and retains | Owning lexical scope |
CompositionDebugView |
CGFloat (scaledDurationToWidth) |
owns value state | Owning lexical scope |
Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.
Concurrency, scheduling, and thread safety
Evidence limit: actor isolation, async/await, or Task creation does not by itself prove background-thread execution; Sendable conformance alone does not prove thread-safe mutation.
| Concern | Source mechanism | Verified placement or handoff | Evidence |
|---|---|---|---|
| Queue scheduling | DispatchQueue(label:) |
The source constructs a dispatch queue; its label alone does not prove a thread. | AVCompositionDebugViewer/Editor/SimpleEditor.swift:95 |
| Queue scheduling | DispatchQueue.main |
The source addresses the main dispatch queue. | AVCompositionDebugViewer/Editor/SimpleEditor.swift:245 |
@MainActor/MainActor.run, DispatchQueue.main, and RunLoop.main are reported as distinct isolation, queue, and event-loop mechanisms. A plain Task is kept separate from Task.detached; neither is labeled as a background thread.
Reference code
AVCompositionDebugViewer/Editor/SimpleEditor.swift:95 — representative execution boundary
class SimpleEditor: NSObject, AVVideoCompositionValidationHandling {
// ...
private let assetQueue = DispatchQueue(label: "assetQueue")
// ...
}State propagation, frameworks, and dependencies
Evidence limit: an import proves a source-level compilation dependency at the cited line; it does not prove runtime use, architectural adoption, or whether a Swift package is a direct application dependency.
| Category | Mechanism or module | Verified role | Evidence |
|---|---|---|---|
| Source import | UIKit |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCompositionDebugViewer/AppDelegate.swift:8 |
| Source import | AVFoundation |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCompositionDebugViewer/DebugView/CompDebugView.swift:11 |
| Source import | Foundation |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCompositionDebugViewer/DebugView/CompDebugView.swift:9 |
| Source import | AVKit |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCompositionDebugViewer/PlayerViewController.swift:11 |
receive(on:) describes downstream delivery scheduling, while subscribe(on:) describes upstream subscription/request/cancel scheduling. An import Combine alone establishes neither behavior nor a Store, reducer, Redux, or other application architecture.
Class and protocol design
AVCompositionDebugViewer/AppDelegate.swift:11 — representative type boundary
@main
class AppDelegate: UIResponder, UIApplicationDelegate {
func application(_ application: UIApplication, didFinishLaunchingWithOptions launchOptions: [UIApplication.LaunchOptionsKey: Any]?) -> Bool {
return true
}
}| Type | Responsibility | Depends on or conforms to |
|---|---|---|
AppDelegate |
Receives callback-driven events | UIResponder, UIApplicationDelegate |
CompositionDebugView |
User-interface presentation and input forwarding | UIView |
PlayerViewController |
View lifecycle, callbacks, and feature coordination | UIViewController |
SceneDelegate |
Receives callback-driven events | UIResponder, UIWindowSceneDelegate |
TimeSliderInset |
Defines a closed set of feature states or choices | Int |
Banner |
Defines a closed set of feature states or choices | Int |
CompositionTrackSegmentInfo |
Represents feature data | Concrete collaborators/imported frameworks |
VideoCompositionStageInfo |
Represents feature data | Concrete collaborators/imported frameworks |
SimpleEditorUtils |
Owns feature behavior and collaborator lifecycle | NSObject |
SourceClip |
Represents a feature value or composable behavior | Concrete collaborators/imported frameworks |
No local protocol conformance is claimed as protocol-oriented design; external framework conformances are listed only as dependencies.
Access control
| Symbol | Access | Verified effect | Likely rationale |
|---|---|---|---|
drawingLayer (AVCompositionDebugViewer/DebugView/CompDebugView.swift:64) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
duration (AVCompositionDebugViewer/DebugView/CompDebugView.swift:65) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
compositionTrackSegmentInfo (AVCompositionDebugViewer/DebugView/CompDebugView.swift:67) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
volumeRampAsPoints (AVCompositionDebugViewer/DebugView/CompDebugView.swift:68) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
Reference code
AVCompositionDebugViewer/DebugView/CompDebugView.swift:64 — representative boundary
class CompositionDebugView: UIView {
// ...
private var drawingLayer: CALayer = CALayer()
// ...
}Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.
Logic ownership and placement
| Logic | Owning type or file | Placement rationale |
|---|---|---|
| View lifecycle, callbacks, and feature coordination | PlayerViewController |
The source’s Controller suffix makes this role explicit. |
| Receives callback-driven events | AppDelegate, SceneDelegate |
The source’s Delegate suffix makes this role explicit. |
| User-interface presentation and input forwarding | CompositionDebugView |
The source’s View suffix makes this role explicit. |
Design patterns
| Pattern | Source evidence | Purpose or tradeoff |
|---|---|---|
| View-controller organization | AVCompositionDebugViewer/PlayerViewController.swift:14 |
A controller is the verified coordination boundary; this is MVC-style only where a separate model is present. |
| Delegate or data-source callbacks | AVCompositionDebugViewer/AppDelegate.swift:11 |
Callback protocols invert event delivery back into the sample’s owner. |
Naming conventions
- Types: Controller: PlayerViewController; Delegate: AppDelegate, SceneDelegate; View: CompositionDebugView.
- Protocols: no local protocol declaration in the scanned source.
- Methods:
application,drawVerticallyCentered,willMove,synchronize,draw,drawCompositionTracks,drawVideoComposition,drawAudioMix. - Files:
AVCompositionDebugViewer/AppDelegate.swift,AVCompositionDebugViewer/Editor/SimpleEditorUtils.swift,AVCompositionDebugViewer/PlayerViewController.swift,AVCompositionDebugViewer/SceneDelegate.swift,AVCompositionDebugViewer/Editor/SimpleEditor.swift.
Architecture takeaways
AppDelegateis the main source-visible entry or composition anchor for this sample.- Framework work reaches UIKit, AVFoundation, AVKit through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
- Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
- Access-control conclusions separate verified language visibility from the likely design rationale.
- The source does not justify labeling the design protocol-oriented.
Source map
| Source file | Relevant symbols |
|---|---|
AVCompositionDebugViewer/AppDelegate.swift |
Cited implementation, AppDelegate, UIKit |
AVCompositionDebugViewer/DebugView/CompDebugView.swift |
Cited implementation, AVFoundation, Foundation, TimeSliderInset, Banner, CompositionTrackSegmentInfo, VideoCompositionStageInfo, CompositionDebugView |
AVCompositionDebugViewer/PlayerViewController.swift |
PlayerViewController, AVKit |
AVCompositionDebugViewer/Editor/SimpleEditor.swift |
DispatchQueue(label:), DispatchQueue.main, SourceClip, SimpleEditor |
AVCompositionDebugViewer/Editor/SimpleEditorUtils.swift |
SimpleEditorUtils, func |
AVCompositionDebugViewer/SceneDelegate.swift |
SceneDelegate |
AVCompositionDebugViewer/DebugView/CompDebugViewCAUtils.swift |
Feature implementation |
AVCompositionDebugViewer/DebugView/CompDebugViewUtils.swift |
Feature implementation |