Customizing a PyTorch operation
At a glance
| Item | Summary |
|---|---|
| Purpose | Implement a custom operation in PyTorch that uses Metal kernels to improve performance. |
| App architecture | A C/Objective-C header, Objective-C++, Python sample with the source-visible chain run_sample → CustomMPSSoftshrinkModel → Metal / metal_stdlib APIs. |
| Main patterns | No named application pattern supported by the extracted structure |
| Project style | 5 scanned source file(s) across C/Objective-C header, Objective-C++, Python, organized around ranked entry, type, and file boundaries. |
| Execution model | No structured execution marker indexed; callback threading requires source review. |
| State/event model | No structured observation or publisher-scheduling marker indexed. |
| Key frameworks/packages | Foundation, Metal, metal_stdlib, torch; these are source dependencies, not architecture labels. |
Project structure
Source bundle/
├── softshrink.py
├── CustomSoftshrink.h
├── CustomSoftshrink.mm
├── compiler.py
└── run_sample.py
Structure observations
- Architecturally prominent files are ranked from entry points and role-named declarations; resource-only paths are omitted.
- Primary languages: C/Objective-C header, Objective-C++, Python.
- The verified tree contains 0 project/configuration file(s) and 3 source declaration(s).
Overall architecture
flowchart LR
N1["run_sample"]
N2["CustomMPSSoftshrinkModel"]
N3["Metal / metal_stdlib APIs"]
N1 --> N2
N2 --> N3
Reference code
run_sample.py:58 — architecture anchor
if __name__ == "__main__":Interpretation
The arrows summarize the source-visible entry, role-named types or folders, and framework direction; when nodes come from structural folders, the sequence is a high-level interpretation rather than proof that every adjacent node calls the next. Ownership is claimed only where the next section cites a stored property or assignment. The diagram is intentionally limited to the dominant path into Metal.
Ownership and state
classDiagram
run_sample --> MetalAPIs : uses
Ownership evidence
softshrink.py:10 — stored dependency or nearest verified ownership anchor
import torch| Owner | Object or state | Relationship | Mutation authority |
|---|---|---|---|
run_sample |
Metal APIs | Uses framework types; no stored lifecycle relationship was detected in the architecture anchor. | The declaring implementation controls calls. |
Composition arrows indicate a source-visible construction expression or locally owned value state; aggregation means the owner stores or receives a dependency without proving exclusive lifetime ownership.
Concurrency, scheduling, and thread safety
Evidence limit: actor isolation, async/await, or Task creation does not by itself prove background-thread execution; Sendable conformance alone does not prove thread-safe mutation.
No source-visible execution, scheduling, or synchronization boundary was found in the indexed source.
@MainActor/MainActor.run, DispatchQueue.main, and RunLoop.main are reported as distinct isolation, queue, and event-loop mechanisms. A plain Task is kept separate from Task.detached; neither is labeled as a background thread.
State propagation, frameworks, and dependencies
Evidence limit: an import proves a source-level compilation dependency at the cited line; it does not prove runtime use, architectural adoption, or whether a Swift package is a direct application dependency.
| Category | Mechanism or module | Verified role | Evidence |
|---|---|---|---|
| Source import | Foundation |
The cited file imports this module; runtime use and architectural role are not inferred. | CustomSoftshrink.mm:12 |
| Source import | Metal |
The cited file imports this module; runtime use and architectural role are not inferred. | CustomSoftshrink.mm:13 |
| Source import | metal_stdlib |
The cited file imports this module; runtime use and architectural role are not inferred. | CustomSoftshrink.h:12 |
| Source import | torch |
The cited file imports this module; runtime use and architectural role are not inferred. | CustomSoftshrink.mm:9 |
receive(on:) describes downstream delivery scheduling, while subscribe(on:) describes upstream subscription/request/cancel scheduling. An import Combine alone establishes neither behavior nor a Store, reducer, Redux, or other application architecture.
Class and protocol design
softshrink.py:33 — representative type boundary
class CustomMPSSoftshrinkModel(nn.Module):
# ...| Type | Responsibility | Depends on or conforms to |
|---|---|---|
CustomMPSSoftshrinkModel |
Feature data or observable state | nn.Module |
SoftshrinkModel |
Feature data or observable state | nn.Module |
MPSSoftshrink |
Owns feature behavior and collaborator lifecycle | nn.Module |
No local protocol conformance is claimed as protocol-oriented design; external framework conformances are listed only as dependencies.
Access control
| Symbol | Access | Verified effect | Likely rationale |
|---|---|---|---|
CustomSoftshrink (CustomSoftshrink.h:11) |
language/file boundary |
Visibility follows header/implementation and language linkage rules. | Inference: the language’s file or module boundary is sufficient for this sample collaboration. |
Reference code
CustomSoftshrink.h:11 — representative boundary
static char *CUSTOM_KERNEL = R"MPS_SOFTSHRINK(
// ...
)MPS_SOFTSHRINK";Swift declarations without a modifier are internal; explicit private, fileprivate, private(set), public, or open entries above are interpreted by language semantics. Objective-C/C samples instead rely on header and implementation boundaries, which are not equivalent to Swift lexical privacy.
Logic ownership and placement
| Logic | Owning type or file | Placement rationale |
|---|---|---|
| Feature data or observable state | CustomMPSSoftshrinkModel, SoftshrinkModel |
The source’s Model suffix makes this role explicit. |
Design patterns
| Pattern | Source evidence | Purpose or tradeoff |
|---|---|---|
| No named application pattern | run_sample.py:58 |
The verified source directly composes concrete framework types; this document avoids forcing a pattern name. |
Naming conventions
- Types: Model: CustomMPSSoftshrinkModel, SoftshrinkModel.
- Protocols: no local protocol declaration in the scanned source.
- Methods:
__init__,forward,extra_repr,state,test_speedup,test_correctness,test_softshrink. - Files: feature/project roles rather than a strict one-type-per-file rule.
Architecture takeaways
run_sampleis the main source-visible entry or composition anchor for this sample.- Framework work reaches Metal, metal_stdlib, torch through a deliberately small high-level chain; the detailed API graph remains inside the cited implementation files.
- Stored-property evidence identifies lifecycle collaboration; it does not by itself prove exclusive object ownership.
- Access-control conclusions separate verified language visibility from the likely design rationale.
- The source does not justify labeling the design protocol-oriented.
Source map
| Source file | Relevant symbols |
|---|---|
run_sample.py |
Cited implementation, Feature implementation |
softshrink.py |
softshrink, CustomMPSSoftshrinkModel, MPSSoftshrink, SoftshrinkModel |
CustomSoftshrink.h |
CustomSoftshrink, metal_stdlib, Feature implementation |
CustomSoftshrink.mm |
Foundation, Metal, torch, Feature implementation |
compiler.py |
Feature implementation |