Subject: Depthkit VFX Graph: Color Missing, HAP Playback Not Working, Unity Template Issues (Windows / Unity 2022.3)

Depthkit Depthkit Expansion Package for Unity
1

Hi Depthkit team,

I’m currently working with the Depthkit Expansion Package and VFX Graph in Unity 2022.3 (URP, Windows), and I’ve hit several issues blocking me from getting a working point cloud in color. I’ve tried both .mp4 and .mov (HAP) formats, but so far I’m unable to get proper color rendering in the Visual Effect Graph.

Priority: VFX Graph Working with Color

System Setup:

• Unity Version: 2022.3 LTS

• Platform: Windows 10

• Depthkit Packages Installed:

• depthkit.core

• depthkit.core.visualeffectgraph

• Render Pipeline: URP

• Video Formats Tested:

• .mp4 (for development)

• .mov (HAP) (encoded via Shutter Encoder)

• VideoPlayer Settings:

• Render Mode: API Only

• Source: Video Clip

• Not using URL / StreamingAssets

• All references assigned correctly to the Depthkit Clip

Main Issues:

  1. VFX Graph shows point cloud without color

• VFX Graph shows the point cloud structure (sometimes just a cube), but no color is ever applied.

• The Visual Effect component displays default texture bindings like DefaultParticle, not the expected colorTex, positionTex, etc.

• The Depthkit VFX Graph Binder is assigned, with valid .mov and .txt files (same export session).

• I’ve verified exposed property names match in the VFX Graph, and the player does appear to play the video.

• I’ve seen the mesh appear briefly in color (likely before it gets culled) — but it always reverts to default or disappears.

  1. Unity can’t play .mov (HAP) files directly

• Using Unity’s built-in VideoPlayer with .mov (HAP) results in:

Error while reading movie: path/to/file.mov

  • I understand Unity doesn’t natively support HAP on Windows — is AVPro Video required for HAP playback?
  • I attempted to install AVPro but ran into issues — is there a supported Depthkit-specific setup for AVPro?

3. Core Look only tested for debugging

  • I tested the Core Look with .mp4, and the mesh briefly appears with color before vanishing (likely due to frustum culling / bounds).
  • I don’t intend to use Core Look long term — it was just for troubleshooting.

4. Unity Template / Demo Project Confusion

  • I downloaded what I believed was a Depthkit Unity project (screenshot attached), but it only included:

vbnet

CopyEdit

_calibration/
_Exports/
Sample Take/
dkproject.json
  • There was no Unity scene, assets, or project structure.
  • Do I need to create a new Unity project manually, then import the Depthkit packages and somehow load this JSON to initialize the project?

My Questions:

  1. What is the officially supported workflow to get HAP files playing in Unity on Windows with VFX Graph?
  2. If Unity’s VideoPlayer can’t handle HAP, is AVPro required — and if so, how should it be configured with Depthkit?
  3. Can .mp4 be reliably used for development without breaking color sync?
  4. Why does the VFX Graph fail to receive colorTex and other textures, even with everything correctly assigned?
  5. Is there a downloadable Unity demo scene/template with working Depthkit VFX integration and correct bounds setup?

Thanks in advance — I’m really close to getting this working and would greatly appreciate guidance on these final steps. Happy to provide screenshots or a minimal repro project if needed.

2

Hi, @RobertGraham - Thanks for sharing here. I’ll dig into this this week to see if I can reproduce. In the meantime, can you share the Phase and/or version number of the Depthkit Expansion Packages for Unity you are using?

If you can share a pared down project, what will likely accelerate things on my end.