Pinch vs Poke

XR Developer

Overview

A real-time, cross-platform experience bridging a React web application and a Meta Quest 3 headset. This project transforms a user's physical living space into a synchronized spatial map, featuring an adaptive audio-processing system that dynamically calibrates to a player's resting vocal pitch, allowing them to combat digital threats using continuous audio frequencies rather than traditional physical inputs.

Technical Contributions

• Adaptive Audio Engineering: Designed and implemented the core "One Input" defense mechanic. I engineered a custom Fast Fourier Transform (FFT) algorithm in C# to analyze live microphone data, creating an adaptive software system that dynamically calibrates to a player’s unique resting vocal pitch rather than relying on hardcoded thresholds.
• Real-Time Network Architecture: Built the Unity-side networking logic using Supabase Realtime websockets. I established the presence-based handshake protocols and engineered the bidirectional state synchronization that allowed the C# client to instantly process and instantiate database inserts triggered by the web app.
• Spatial Data Serialization: Integrated the Meta MR Utility Kit (MRUK) to extract the VR player's physical room boundaries. I developed the logic to parse, scale, and serialize this local 3D mesh data into a JSON payload, securely pushing it to the cloud so it could be accurately reconstructed on the 2D web client.