Gaussian splats on visionOS

At a glance

Project structure

Source bundle/
└── GaussianSplatsOnVisionOS/
    ├── GaussianSplatsOnVisionOSApp.swift  # GaussianSplatsOnVisionOSApp
    ├── AppModel.swift  # AppModel, ImmersiveSpaceState, LoadedAsset
    ├── SplatView.swift  # SplatViewCoordinator, SplatView, SnapOffset
    ├── SplatEntityBuilder.swift  # GaussianSplatBuffers, GaussianSplatError
    ├── ContentView.swift  # ContentView
    ├── SceneReconstructionManager.swift  # SceneReconstructionManager
    ├── PLYParser.swift  # PLYProperty, GaussianSplatData, PLYHeader
    └── USDLoader.swift  # SplatAttributes

Structure observations

• The runtime boundary is WindowGroup + ImmersiveSpace; the pruned tree lists only files that explain lifecycle, state, or framework integration.
• App code is split into role-named views, models, managers, providers, components, or systems.

Overall architecture

flowchart LR
    GaussianSplatsOnVisionOSApp_1["GaussianSplatsOnVisionOSApp"]
    WindowGroup___ImmersiveSpace_2["WindowGroup + ImmersiveSpace"]
    ContentView_3["ContentView"]
    AppModel_4["AppModel"]
    RealityView_entity_graph_5["RealityView entity graph"]
    ARKit_mesh_updates___Gaussian_splat_renderer_6["ARKit mesh updates + Gaussian-splat renderer"]
    GaussianSplatsOnVisionOSApp_1 --> WindowGroup___ImmersiveSpace_2
    WindowGroup___ImmersiveSpace_2 --> ContentView_3
    ContentView_3 --> AppModel_4
    AppModel_4 --> RealityView_entity_graph_5
    RealityView_entity_graph_5 --> ARKit_mesh_updates___Gaussian_splat_renderer_6

Reference code

GaussianSplatsOnVisionOS/GaussianSplatsOnVisionOSApp.swift:11 — the app or executable entry declares the outer scene lifecycle.

struct GaussianSplatsOnVisionOSApp: App {
    // ...
}

The diagram is a responsibility flow, not a claim that every adjacent node directly calls the next. It keeps scene ownership, shared state, RealityKit content, and framework-provider work at separate levels.

Ownership and state

classDiagram
    GaussianSplatsOnVisionOSApp *-- AppModel : appModel
    ContentView o-- AppModel : appModel
    SceneReconstructionManager *-- ARKitSession : session
    SplatView *-- SplatViewCoordinator : coordinator

Ownership evidence

GaussianSplatsOnVisionOS/GaussianSplatsOnVisionOSApp.swift:12 — representative stored state or the nearest verified lifecycle anchor.

    @State private var appModel = AppModel()

Ownership here is deliberately narrow: @Environment and weak references are shared links, initialized @State or stored services are lifecycle ownership, and a RealityView content closure owns additions to its entity graph without making the SwiftUI view a reference-type owner.

Class and protocol design

The source defines no local substitution protocol in the reviewed boundary. Its protocol use is framework-facing (App, View, RealityKit/ARKit protocols, or platform adapters), so this document does not label the whole app protocol-oriented.

Access control

No reviewed declaration uses fileprivate, private(set), public, open; unmodified Swift declarations are internal.

Reference code

GaussianSplatsOnVisionOS/ContentView.swift:11 — representative visibility boundary.

    @Environment(AppModel.self) private var appModel

Logic ownership and placement

Design patterns

Naming conventions

• Role suffixes are evidence, not decoration: App: GaussianSplatsOnVisionOSApp; Model: AppModel; Coordinator: SplatViewCoordinator; Manager: SceneReconstructionManager.
• Protocols: no app-defined protocol in the reviewed source.
• Commands use verb-led methods: configureSpotLight, syncSplat, loadAsset, configureManipulableObject, snapToNearestSurface, makeSplatEntity, makeDescriptor, makeSHDescriptor.
• Files generally match their primary type; Views, Models, Managers, Providers, Components, Systems, and Packages folders describe architectural roles where present.

Architecture takeaways

• Treat GaussianSplatsOnVisionOSApp as the owner of scene declarations, not as the owner of every RealityKit entity created later.
• Keep view-local interaction in SwiftUI, but move provider sessions, playback resources, shared game state, or transport state into a stable owner when their lifetime exceeds one render pass.
• Run ARKit providers for the scene lifetime and consume their asynchronous updates in cancellable tasks; map anchors to entities at the boundary.
• Model immersive-space open, transition, and close states explicitly so windows and immersive content cannot drift apart.

Source map

• Official Apple documentation