Segmenting objects using taps, scribbles or rectangles
At a glance
| Item | Summary |
|---|---|
| Purpose | Select objects or regions in a photo using taps, scribbles, or rectangle selection, and generate a segmentation mask using the iterative segmentation API. |
| App architecture | A Swift sample with the source-visible chain TapToSegmentApp → ContentView → SegmentationHandler → Vision APIs. |
| Main patterns | No named application pattern supported by the extracted structure |
| Project style | 3 scanned source file(s) across Swift, organized around ranked entry, type, and file boundaries. |
Project structure
Source bundle/
├── TapToSegment/
│ ├── TapToSegmentApp.swift
│ ├── SegmentationHandler.swift
│ └── ContentView.swift
├── Configuration/
│ └── SampleCode.xcconfig
└── TapToSegment.xcodeproj/
├── .xcodesamplecode.plist
└── project.pbxproj
Structure observations
- Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
- Primary languages: Swift.
- The verified tree contains 3 project/configuration file(s) and 4 source declaration(s).
Overall architecture
flowchart LR
N1["TapToSegmentApp"]
N2["ContentView"]
N3["SegmentationHandler"]
N4["Vision APIs"]
N1 --> N2
N2 --> N3
N3 --> N4
Reference code
TapToSegment/TapToSegmentApp.swift:10 — architecture anchor
@main
struct TapToSegmentApp: App {
var body: some Scene {
WindowGroup {
ContentView()
}
}
}Interpretation
The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into Vision.
Ownership and state
classDiagram
SegmentationHandler o-- ProgressReporter : assetDownloadingProgressReport
SegmentationHandler o-- GenerateIterativeSegmentationRequest : segmentationRequest
SegmentationHandler o-- ImageRequestHandler : imageHandler
ContentView *-- SegmentationHandler : segmentationHandler
Ownership evidence
TapToSegment/SegmentationHandler.swift:14 — stored dependency or nearest verified ownership anchor
@Observable
class SegmentationHandler {
// ...
var assetDownloadingProgressReport: ProgressReporter? = nil
// ...
}| Owner | Object or state | Relationship | Mutation authority |
|---|---|---|---|
SegmentationHandler |
ProgressReporter (assetDownloadingProgressReport) |
stores or receives | App/module collaborators |
SegmentationHandler |
GenerateIterativeSegmentationRequest (segmentationRequest) |
stores or receives | Owning lexical scope |
SegmentationHandler |
ImageRequestHandler (imageHandler) |
stores or receives | Owning lexical scope |
ContentView |
SegmentationHandler (segmentationHandler) |
owns wrapper-managed state | Owning lexical scope |
Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.
Class and protocol design
TapToSegment/TapToSegmentApp.swift:11 — representative type boundary
struct TapToSegmentApp: App {
var body: some Scene {
WindowGroup {
ContentView()
}
}
}| Type | Responsibility | Depends on or conforms to |
|---|---|---|
TapToSegmentApp |
Application entry and top-level composition | App |
SegmentationHandler |
Handles callbacks or feature events | Concrete collaborators/imported frameworks |
ContentView |
User-interface presentation and input forwarding | View |
SegmentationError |
Represents feature failure conditions | Error |
No local protocol conformance is claimed as protocol-oriented design; external framework conformances are listed only as dependencies.
Access control
| Symbol | Access | Verified effect | Likely rationale |
|---|---|---|---|
segmentationHandler (TapToSegment/ContentView.swift:13) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
selectedPhoto (TapToSegment/ContentView.swift:14) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
selectedImage (TapToSegment/ContentView.swift:15) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
originalUIImage (TapToSegment/ContentView.swift:16) |
private |
Use is restricted to the lexical declaration and same-file extensions allowed by Swift. | Inference: keep state mutation or dependency lifetime inside the owning implementation. |
Reference code
TapToSegment/ContentView.swift:13 — representative boundary
@State private var segmentationHandler = SegmentationHandler()
@State private var selectedPhoto: PhotosPickerItem?
@State private var selectedImage: Image?
@State private var originalUIImage: UIImage?
@State private var displayedImageRect = CGRect()
@State private var segmentationMaskImage: UIImage?Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.
Logic ownership and placement
| Logic | Owning type or file | Placement rationale |
|---|---|---|
| Application entry and top-level composition | TapToSegmentApp |
The source’s App suffix makes this role explicit. |
| Handles callbacks or feature events | SegmentationHandler |
The source’s Handler suffix makes this role explicit. |
| User-interface presentation and input forwarding | ContentView |
The source’s View suffix makes this role explicit. |
Design patterns
| Pattern | Source evidence | Purpose or tradeoff |
|---|---|---|
| No named application pattern | TapToSegment/TapToSegmentApp.swift:10 |
The verified source directly composes concrete framework types; this document avoids forcing a pattern name. |
Naming conventions
- Types: App: TapToSegmentApp; Handler: SegmentationHandler; View: ContentView.
- Protocols: no local protocol declaration in the scanned source.
- Methods:
prepareAsset,setImage,perform,performSegmentation,convertPoint,resetRequest,calculateImagePosition,scribbleCanvas. - Files:
TapToSegment/TapToSegmentApp.swift,TapToSegment/SegmentationHandler.swift,TapToSegment/ContentView.swift.
Architecture takeaways
TapToSegmentAppis the main source-visible entry or composition anchor for this sample.- Framework work reaches SwiftUI, PhotosUI, Vision through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
- Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
- Access-control conclusions separate verified language visibility from the likely design rationale.
- The source does not justify labeling the design protocol-oriented.
Source map
| Source file | Relevant symbols |
|---|---|
TapToSegment/TapToSegmentApp.swift |
TapToSegmentApp |
TapToSegment/SegmentationHandler.swift |
SegmentationHandler, SegmentationError |
TapToSegment/ContentView.swift |
ContentView |