AVCamFilter: Applying filters to a capture stream
At a glance
| Item | Summary |
|---|---|
| Purpose | Render a capture stream with rose-colored filtering and depth effects. |
| App architecture | A C/Objective-C header, Metal, Objective-C, Swift sample with the source-visible chain AppDelegate → CameraViewController → FilterRenderer → CoreMedia / CoreVideo APIs. |
| Main patterns | View-controller organization, Protocol-oriented abstraction, Delegate or data-source callbacks |
| Project style | 15 scanned source file(s) across C/Objective-C header, Metal, Objective-C, Swift, organized around ranked entry, type, and file boundaries. |
| Execution model | Source-visible boundaries: DispatchQueue(label:), DispatchQueue.main.async; none alone proves a background thread. |
| State/event model | Source-visible mechanisms: NotificationCenter. |
| Key frameworks/packages | CoreMedia, CoreVideo, Metal, metal_stdlib, UIKit; these are source dependencies, not architecture labels. |
Project structure
Source bundle/
└── AVCamFilter/
├── AppDelegate.swift
├── CameraViewController.swift
├── DepthToGrayscaleConverter.swift
├── PreviewMetalView.swift
├── FilterRenderer.swift
├── RosyCIRenderer.swift
├── RosyMetalRenderer.swift
├── Shaders/
│ ├── Mixer.metal
│ ├── DepthToGrayscale.metal
│ └── PassThrough.metal
├── VideoMixer.swift
└── AVCamFilter-Bridging-Header.h
Structure observations
- Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
- Primary languages: C/Objective-C header, Metal, Objective-C, Swift.
- The verified tree contains 6 project/configuration file(s) and 16 source declaration(s).
Overall architecture
flowchart LR
N1["AppDelegate"]
N2["CameraViewController"]
N3["FilterRenderer"]
N4["CoreMedia / CoreVideo APIs"]
N1 --> N2
N2 --> N3
N3 --> N4
Reference code
AVCamFilter/AppDelegate.swift:10 — architecture anchor
@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
var window: UIWindow?
}Interpretation
The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into AVFoundation.
Ownership and state
classDiagram
AppDelegate o-- UIWindow : window
CameraViewController *-- Bool : videoFilterOn
CameraViewController *-- Bool : depthVisualizationOn
CameraViewController *-- Bool : depthSmoothingOn
Ownership evidence
AVCamFilter/AppDelegate.swift:12 — stored dependency or nearest verified ownership anchor
@UIApplicationMain
class AppDelegate: UIResponder, UIApplicationDelegate {
var window: UIWindow?
}| Owner | Object or state | Relationship | Mutation authority |
|---|---|---|---|
AppDelegate |
UIWindow (window) |
stores or receives | App/module collaborators |
CameraViewController |
Bool (videoFilterOn) |
owns value state | Owning lexical scope |
CameraViewController |
Bool (depthVisualizationOn) |
owns value state | Owning lexical scope |
CameraViewController |
Bool (depthSmoothingOn) |
owns value state | Owning lexical scope |
Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.
Concurrency, scheduling, and thread safety
Evidence limit: actor isolation, async/await, or Task creation does not by itself prove background-thread execution; Sendable conformance alone does not prove thread-safe mutation.
| Concern | Source mechanism | Verified placement or handoff | Evidence |
|---|---|---|---|
| Queue scheduling | DispatchQueue(label:) |
The source constructs a dispatch queue; its label alone does not prove a thread. | AVCamFilter/CameraViewController.swift:67 |
| Queue scheduling | DispatchQueue.main.async |
The source addresses the main dispatch queue. | AVCamFilter/CameraViewController.swift:225 |
@MainActor/MainActor.run, DispatchQueue.main, and RunLoop.main are reported as distinct isolation, queue, and event-loop mechanisms. A plain Task is kept separate from Task.detached; neither is labeled as a background thread.
Reference code
AVCamFilter/CameraViewController.swift:67 — representative execution boundary
class CameraViewController: UIViewController, AVCapturePhotoCaptureDelegate, AVCaptureVideoDataOutputSampleBufferDelegate, AVCaptureDepthDataOutputDelegate, AVCaptureDataOutputSynchronizerDelegate {
// ...
private let sessionQueue = DispatchQueue(label: "SessionQueue", attributes: [], autoreleaseFrequency: .workItem)
// ...
}State propagation, frameworks, and dependencies
Evidence limit: an import proves a source-level compilation dependency at the cited line; it does not prove runtime use, architectural adoption, or whether a Swift package is a direct application dependency.
| Category | Mechanism or module | Verified role | Evidence |
|---|---|---|---|
| State propagation | NotificationCenter |
NotificationCenter distributes named process-local events. | AVCamFilter/CameraViewController.swift:381 |
| Source import | CoreMedia |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCamFilter/DepthToGrayscaleConverter.swift:8 |
| Source import | CoreVideo |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCamFilter/CameraViewController.swift:10 |
| Source import | Metal |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCamFilter/DepthToGrayscaleConverter.swift:10 |
| Source import | metal_stdlib |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCamFilter/Shaders/DepthToGrayscale.metal:8 |
| Source import | UIKit |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCamFilter/AppDelegate.swift:8 |
| Source import | AVFoundation |
The cited file imports this module; runtime use and architectural role are not inferred. | AVCamFilter/CameraViewController.swift:9 |
receive(on:) describes downstream delivery scheduling, while subscribe(on:) describes upstream subscription/request/cancel scheduling. An import Combine alone establishes neither behavior nor a Store, reducer, Redux, or other application architecture.
Class and protocol design
AVCamFilter/FilterRenderer.swift:10 — representative type boundary
protocol FilterRenderer: AnyObject {
// ...
var description: String { get }
// ...
}| Type | Responsibility | Depends on or conforms to |
|---|---|---|
AppDelegate |
Receives callback-driven events | UIResponder, UIApplicationDelegate |
FilterRenderer |
Defines a capability or collaboration contract | AnyObject |
CameraViewController |
View lifecycle, callbacks, and feature coordination | UIViewController, AVCapturePhotoCaptureDelegate, AVCaptureVideoDataOutputSampleBufferDelegate, AVCaptureDepthDataOutputDelegate, AVCaptureDataOutputSynchronizerDelegate |
DepthToGrayscaleConverter |
Transforms between feature representations | FilterRenderer |
PreviewMetalView |
User-interface presentation and input forwarding | MTKView |
RosyCIRenderer |
Owns drawing, GPU, or presentation processing | FilterRenderer |
RosyMetalRenderer |
Owns drawing, GPU, or presentation processing | FilterRenderer |
SessionSetupResult |
Represents the result of an operation | Concrete collaborators/imported frameworks |
DepthRenderParam |
Represents a feature value or composable behavior | Concrete collaborators/imported frameworks |
Rotation |
Defines a closed set of feature states or choices | Int |
The source explicitly defines local protocol relationships: DepthToGrayscaleConverter → FilterRenderer, RosyCIRenderer → FilterRenderer, RosyMetalRenderer → FilterRenderer.
Access control
| Symbol | Access | Verified effect | Likely rationale |
|---|---|---|---|
videoFilterOn (AVCamFilter/CameraViewController.swift:32) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
depthVisualizationOn (AVCamFilter/CameraViewController.swift:36) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
depthSmoothingOn (AVCamFilter/CameraViewController.swift:40) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
setupResult (AVCamFilter/CameraViewController.swift:60) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
Reference code
AVCamFilter/CameraViewController.swift:32 — representative boundary
class CameraViewController: UIViewController, AVCapturePhotoCaptureDelegate, AVCaptureVideoDataOutputSampleBufferDelegate, AVCaptureDepthDataOutputDelegate, AVCaptureDataOutputSynchronizerDelegate {
// ...
private var videoFilterOn: Bool = false
// ...
}Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.
Logic ownership and placement
| Logic | Owning type or file | Placement rationale |
|---|---|---|
| View lifecycle, callbacks, and feature coordination | CameraViewController |
The source’s Controller suffix makes this role explicit. |
| Transforms between feature representations | DepthToGrayscaleConverter |
The source’s Converter suffix makes this role explicit. |
| Receives callback-driven events | AppDelegate |
The source’s Delegate suffix makes this role explicit. |
| Owns drawing, GPU, or presentation processing | FilterRenderer, RosyCIRenderer, RosyMetalRenderer |
The source’s Renderer suffix makes this role explicit. |
| User-interface presentation and input forwarding | PreviewMetalView |
The source’s View suffix makes this role explicit. |
Design patterns
| Pattern | Source evidence | Purpose or tradeoff |
|---|---|---|
| View-controller organization | AVCamFilter/CameraViewController.swift:14 |
A controller is the verified coordination boundary; this is MVC-style only where a separate model is present. |
| Protocol-oriented abstraction | AVCamFilter/DepthToGrayscaleConverter.swift:12 |
A local protocol and concrete conformance create an explicit capability boundary. |
| Delegate or data-source callbacks | AVCamFilter/AppDelegate.swift:11 |
Callback protocols invert event delivery back into the sample’s owner. |
Naming conventions
- Types: Controller: CameraViewController; Converter: DepthToGrayscaleConverter; Delegate: AppDelegate; Renderer: FilterRenderer, RosyCIRenderer, RosyMetalRenderer; View: PreviewMetalView.
- Protocols:
FilterRenderer. - Methods:
viewDidLoad,viewWillAppear,viewWillDisappear,didEnterBackground,willEnterForground,thermalStateChanged,showThermalState,viewWillTransition. - Files:
AVCamFilter/AppDelegate.swift,AVCamFilter/CameraViewController.swift,AVCamFilter/DepthToGrayscaleConverter.swift,AVCamFilter/PreviewMetalView.swift,AVCamFilter/FilterRenderer.swift,AVCamFilter/RosyCIRenderer.swift.
Architecture takeaways
AppDelegateis the main source-visible entry or composition anchor for this sample.- Framework work reaches CoreMedia, CoreVideo, Metal, metal_stdlib through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
- Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
- Access-control conclusions separate verified language visibility from the likely design rationale.
- Local protocol relationships provide an explicit substitution boundary.
Source map
| Source file | Relevant symbols |
|---|---|
AVCamFilter/AppDelegate.swift |
Cited implementation, UIKit, AppDelegate |
AVCamFilter/FilterRenderer.swift |
FilterRenderer |
AVCamFilter/CameraViewController.swift |
Cited implementation, CameraViewController, DispatchQueue(label:), DispatchQueue.main.async, NotificationCenter, CoreVideo, AVFoundation, SessionSetupResult, func |
AVCamFilter/DepthToGrayscaleConverter.swift |
Cited implementation, CoreMedia, Metal, DepthToGrayscaleConverter, DepthRenderParam |
AVCamFilter/Shaders/DepthToGrayscale.metal |
metal_stdlib, converterParameters |
AVCamFilter/PreviewMetalView.swift |
PreviewMetalView, Rotation |
AVCamFilter/RosyCIRenderer.swift |
RosyCIRenderer |
AVCamFilter/RosyMetalRenderer.swift |
RosyMetalRenderer |
AVCamFilter/Shaders/Mixer.metal |
VertexIO, mixerParameters |
AVCamFilter/VideoMixer.swift |
VideoMixer, MixerParameters |
AVCamFilter/Shaders/PassThrough.metal |
VertexIO |
AVCamFilter/AVCamFilter-Bridging-Header.h |
Feature implementation |
AVCamFilter/Shaders/RosyEffect.metal |
Feature implementation |
AVCamFilter/minMaxFromBuffer.h |
Feature implementation |
AVCamFilter/minMaxFromBuffer.m |
Feature implementation |