Description:
I made a real-time finger tracking system that sends hand position data from P5.js to Unity using WebSockets to control object movement. This is used to play a game similar to Fruit Ninja, slicing through fruit to obtain points.
I made a real-time finger tracking system that sends hand position data from P5.js to Unity using WebSockets to control object movement. This is used to play a game similar to Fruit Ninja, slicing through fruit to obtain points.
My contributions:
- Built a hand-tracking game using p5.js and JavaScript, modified to track the index finger via webcam.
- Created interactive gameplay mechanics (like slicing fruit) based on real-time finger input.
- Set up a websocket connection between p5.js, Processing, and Unity.
- Wrote Processing code to receive and forward data via websocket.
- Developed a Unity scene that receives and visualizes finger position using C# and the NativeWebSocket library.
- Integrated multiple environments and programming languages (JavaScript, Java, C#) into one functional prototype.
- Created interactive gameplay mechanics (like slicing fruit) based on real-time finger input.
- Set up a websocket connection between p5.js, Processing, and Unity.
- Wrote Processing code to receive and forward data via websocket.
- Developed a Unity scene that receives and visualizes finger position using C# and the NativeWebSocket library.
- Integrated multiple environments and programming languages (JavaScript, Java, C#) into one functional prototype.
More:
The game is inspired by Fruit Ninja. I replaced the swiping on touch by swiping your finger through the air. Hitting the falling fruit gives you points, varied by different fruit types.
The game is inspired by Fruit Ninja. I replaced the swiping on touch by swiping your finger through the air. Hitting the falling fruit gives you points, varied by different fruit types.
