[PYTHON] AirGesture - Play games without touching keyboard
Introduction
Here is my python source code for AirGesture - Play games without touching keyboard. This project is an application of hand detection model in Tensorflow. With my code, you could play many games on PC without using any keyboard. At the moment you could play the following games
- Super Mario Bros by running the script mario.py
- Battle City by running the script battle_city.py
- Dinosaur Game by running the script dinosaur.py
Please make sure that only one hand shown in front of camera. Otherwise scripts may not work as well as you expect
Super Mario Bros
The screen is splitted into 3 equal parts horizontally.
Here is the mapping between your gesture and Mario's movement:
- Open hand within the left part -> Left jump
- Closed hand within the left part -> Left run
- Open hand within the middle part -> Jump
- Closed hand within the middle part -> Do nothing
- Open hand within the right part -> Right jump
- Closed hand within the right part -> Right run
Super Mario Bros
Battle City
The screen is splitted into 5 parts, including 4 triangles and a circle.
Here is the mapping between your gesture and tank's movement:
- Open hand -> Fire
- Closed hand within the circle -> Do nothing
- Closed hand within the left triangle -> Go left
- Closed hand within the right triangle -> Go right
- Closed hand within the up triangle -> Go up
- Closed hand within the left triangle -> Go down
Battle City
Dinosaur Game
The screen is splitted into 2 equal parts vertically.
Here is the mapping between your gesture and dinosaur's action:
- Closed hand -> Run
- Open hand within the upper part -> Jump
- Open hand within the lower part -> Duck
Dinosaur
Requirements
- python 3.x
- cv2
- tensorflow
- numpy
- gym
- gym_super_mario_bros
- gym_chrome_dino
- pygame
- opencv
