Hole in the Wall Game Using a Leap Motion Hand Gesture Controller
By using a Leap Motion controller, a player will have to use their physical hands to arrange virtual blocks in a specific way to fit through a hole in a wall that is moving down a table. Each time a new wall appears it travels faster, giving the player less time to assemble the blocks as the levels progress.
Engineer
Jasper H
Area of Interest
Aerospace Engineering
School
Horace Mann School
Grade
Incoming Senior
Third Milestone
For my third milestone, I completed the entirety of my game. There are now nine functional buttons on the control panel, eight of which are used for spawning different walls. The mechanics of the buttons are described in the second milestone section below. The ninth button is used as a restart button which teleports the walls back to their spawn point at the end of the table. In addition to the buttons, the slider at the bottom of the panel now works as well. The slider works by outputting a percentage taking from its position along its slide-able area. A portion of the WallBehaviorScript (shown in the second milestone section below) then takes that percentage and multiplies it by a predetermined maximum speed in the form of a float value. The product is used as the speed of the walls. Thus, for example, if the slider is 50% of the way down its slide-able area, the current wall will have a speed of 50% its maximum speed. There is also six interactable cubes now, each assigned with their respective respawn scripts. Finally, I fixed some of the light sources in the scenery to prevent objects from over-saturation and to improve atmosphere and reflection quality.
Second Milestone
For my second milestone, I completed the scenery of my game alongside a few components of my game’s mechanics. For the scenery, I went for a sci-fi, futuristic look. The game takes place in a large room with neon lights on the edges of objects and hanging from the ceiling. The room is also scattered with abstract decorations and simple furniture. The gameplay takes place on a table in the center of the room. For the technical improvements of the game, there are now two playable walls and a control panel. Through a simple wall behavior script, the walls move from a spawn point at one end of the table to a way point at the other end. Each wall has a specific shape that the cubes must fit through by stacking them in certain ways. To the left of the player view, there is a control panel with 9 buttons and a slider. Currently 2 of the 9 buttons are functional. The purpose of the buttons is to spawn different models of the walls, giving the player different shaped holes with ranging degrees of difficulty. The buttons interact with the wall behavior script by calling a specific wall from an array of meshes called Wall[]. Each button has a number assigned to it, so when (for example) the first button is pressed, the script will call Wall[0] (in an array, the 0th component is the first component) because the first button has the number 0 assigned to it. The second button will call Wall[1], the third will call Wall[2], and so on.
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
public class RespawnObject : MonoBehaviour {
public Transform SpawnPoint;
private void OnTriggerEnter(Collider other)
{
if (other.gameObject.tag == "blocktrigger")
{
transform.position = SpawnPoint.position;
}
}
}
using System.Collections;
using System.Collections.Generic;
using UnityEngine;
using Leap.Unity.Interaction;
public class WallBehavior : MonoBehaviour {
public Transform[] wayPointList;
public Transform WayPoint;
public Transform SpawnPoint;
public GameObject[] Wall;
public InteractionSlider Slider;
public int currentWayPoint = 0;
Transform targetWayPoint;
public float speed = 4f;
// Use this for initialization
void Start()
{
}
public void ButtonManager(int WhichButton)
{
foreach(GameObject w in Wall)
{
w.SetActive(false);
}
Wall[WhichButton].SetActive(true);
}
public void RestartButton()
{
transform.position = SpawnPoint.position;
}
// Update is called once per frame
void Update()
{
// check if object has somewhere to move to
if (currentWayPoint < this.wayPointList.Length)
{
if (targetWayPoint == null)
{
targetWayPoint = wayPointList[currentWayPoint];
}
walk();
}
if(Slider.isPressed)
{
float SV;
SV = Slider.HorizontalSliderValue;
speed = .3f * SV;
}
}
void walk()
{
// move towards the target
transform.position = Vector3.MoveTowards(transform.position, targetWayPoint.position, speed * Time.deltaTime);
if(transform.position == WayPoint.position)
{
transform.position = SpawnPoint.position;
}
if (transform.position == targetWayPoint.position)
{
currentWayPoint++;
targetWayPoint = wayPointList[currentWayPoint];
}
}
}
First Milestone
For my first milestone in my project, I managed to get a working demo of the mechanics that will make my game work. More specifically, I created a demo game in which a player can pick up blocks on screen and assemble them with their bare hands using a Leap Motion controller. The controller works by using three infrared LEDs and two optical cameras to detect the presence of hands within a 8 cubic foot range. The LEDs light up your hands which, in turn, reflect the infrared light back to the cameras. The data from the cameras is transferred to the computer, which compiles the data in the form of a grayscale stereo image. By only detecting infrared light in the scene, the Leap Motion software is able to isolate your hands from any other objects nearby. The software then runs its algorithm to create a 3D model of what is in the image. The algorithm can also use the given information to approximate the position of hidden fingers or other parts of the hand to help improve the accuracy of the 3D model. The positional data is then used in any situation that calls for it. In my case, my game calls the data through Leap Motion’s Unity plugin, which provides prefabricated hand models and scripts. In my demo, there are four cubes, each programmed with their own interaction script. The scripts recognize when your hand is doing a pinching gesture and makes their corresponding cubes follow the path of the pinching hand, making it appear as if the player is grabbing the cube and moving it around.