Sample CodeiOS, iPadOS, Mac Catalyst, macOS, visionOSReviewed 2026-07-21View on Apple Developer

Segmenting objects using taps, scribbles or rectangles

At a glance

Item Summary
Purpose Select objects or regions in a photo using taps, scribbles, or rectangle selection, and generate a segmentation mask using the iterative segmentation API.
App architecture A Swift sample with the source-visible chain TapToSegmentAppContentViewSegmentationHandlerVision APIs.
Main patterns No named application pattern supported by the extracted structure
Project style 3 scanned source file(s) across Swift, organized around ranked entry, type, and file boundaries.

Project structure

Source bundle/
├── TapToSegment/
│   ├── TapToSegmentApp.swift
│   ├── SegmentationHandler.swift
│   └── ContentView.swift
├── Configuration/
│   └── SampleCode.xcconfig
└── TapToSegment.xcodeproj/
    ├── .xcodesamplecode.plist
    └── project.pbxproj

Structure observations

  • Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
  • Primary languages: Swift.
  • The verified tree contains 3 project/configuration file(s) and 4 source declaration(s).

Overall architecture

Reference code

TapToSegment/TapToSegmentApp.swift:10 — architecture anchor

@main
struct TapToSegmentApp: App {
    var body: some Scene {
        WindowGroup {
            ContentView()
        }
    }
}

Interpretation

The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into Vision.

Ownership and state

Ownership evidence

TapToSegment/SegmentationHandler.swift:14 — stored dependency or nearest verified ownership anchor

@Observable
class SegmentationHandler {
    // ...
    var assetDownloadingProgressReport: ProgressReporter? = nil
    // ...
}
Owner Object or state Relationship Mutation authority
SegmentationHandler ProgressReporter (assetDownloadingProgressReport) stores or receives App/module collaborators
SegmentationHandler GenerateIterativeSegmentationRequest (segmentationRequest) stores or receives Owning lexical scope
SegmentationHandler ImageRequestHandler (imageHandler) stores or receives Owning lexical scope
ContentView SegmentationHandler (segmentationHandler) owns wrapper-managed state Owning lexical scope

Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.

Class and protocol design

TapToSegment/TapToSegmentApp.swift:11 — representative type boundary

struct TapToSegmentApp: App {
    var body: some Scene {
        WindowGroup {
            ContentView()
        }
    }
}
Type Responsibility Depends on or conforms to
TapToSegmentApp Application entry and top-level composition App
SegmentationHandler Handles callbacks or feature events Concrete collaborators/imported frameworks
ContentView User-interface presentation and input forwarding View
SegmentationError Represents feature failure conditions Error

No local protocol conformance is claimed as protocol-oriented design; external framework conformances are listed only as dependencies.

Access control

Symbol Access Verified effect Likely rationale
segmentationHandler (TapToSegment/ContentView.swift:13) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: keep state mutation or dependency lifetime inside the owning implementation.
selectedPhoto (TapToSegment/ContentView.swift:14) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: keep state mutation or dependency lifetime inside the owning implementation.
selectedImage (TapToSegment/ContentView.swift:15) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: keep state mutation or dependency lifetime inside the owning implementation.
originalUIImage (TapToSegment/ContentView.swift:16) private Use is restricted to the lexical declaration and same-file extensions allowed by Swift. Inference: keep state mutation or dependency lifetime inside the owning implementation.

Reference code

TapToSegment/ContentView.swift:13 — representative boundary

    @State private var segmentationHandler = SegmentationHandler()
    @State private var selectedPhoto: PhotosPickerItem?
    @State private var selectedImage: Image?
    @State private var originalUIImage: UIImage?
    @State private var displayedImageRect = CGRect()
    @State private var segmentationMaskImage: UIImage?

Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.

Logic ownership and placement

Logic Owning type or file Placement rationale
Application entry and top-level composition TapToSegmentApp The source’s App suffix makes this role explicit.
Handles callbacks or feature events SegmentationHandler The source’s Handler suffix makes this role explicit.
User-interface presentation and input forwarding ContentView The source’s View suffix makes this role explicit.

Design patterns

Pattern Source evidence Purpose or tradeoff
No named application pattern TapToSegment/TapToSegmentApp.swift:10 The verified source directly composes concrete framework types; this document avoids forcing a pattern name.

Naming conventions

  • Types: App: TapToSegmentApp; Handler: SegmentationHandler; View: ContentView.
  • Protocols: no local protocol declaration in the scanned source.
  • Methods: prepareAsset, setImage, perform, performSegmentation, convertPoint, resetRequest, calculateImagePosition, scribbleCanvas.
  • Files: TapToSegment/TapToSegmentApp.swift, TapToSegment/SegmentationHandler.swift, TapToSegment/ContentView.swift.

Architecture takeaways

  • TapToSegmentApp is the main source-visible entry or composition anchor for this sample.
  • Framework work reaches SwiftUI, PhotosUI, Vision through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
  • Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
  • Access-control conclusions separate verified language visibility from the likely design rationale.
  • The source does not justify labeling the design protocol-oriented.

Source map

Source file Relevant symbols
TapToSegment/TapToSegmentApp.swift TapToSegmentApp
TapToSegment/SegmentationHandler.swift SegmentationHandler, SegmentationError
TapToSegment/ContentView.swift ContentView