DEVLOG

Mixed Reality Fish Simulation

Interactive Mixed Reality BOID simulation. Attractor/Avoidance spheres are placed in the users hands and they can interact with the fish flocking simulation. Credits go to Ghislain Girardot for the BOIDS tutorial & Fish Model.

Setup:

Oculus Quest Pro + Unreal Engine. Primary APIs/Systems: Meta Prescence, Unreal Niagara

---

Audio Visualization in UE4

This project uses the TensorFlow Spleeter model to separate musical instruments from a compressed mp3 file (Source separation/Stem extraction). After, Each instrument is connected to a visual element in the engine, Which has its parameters driven by amplitude/frequency, In the case below the following instruments are used

Vocals: Red HMD
Drums: Blue bars
Bass: Purple cloud
Synth: UE4 MatBall

---

Interactive Fluid Sim

Using KinectV2 to track hand positions, and sending the data into an unreal-engine material based fluid simulation.

---

Mobile Game WIP

This is a prototype I created in my free time. It is a top-down mobile game with controls similar to 王者荣耀(Chinese MOBA) the focus is to make a co-operative PvE Game.

---