👀 Lay back and watch the ball roll where you want it to go.
🤖 Compete with an RL agent.
EyeBall-GamePlay.mp4
Avoid obstacles by jumping or swaping lanes
If you are on Windows you need Microsoft Visual C++ Redistributable 2015-2022 to run mediapipe, else you get DLL load errors.
Check your architecture with:
python -c "import platform; print(platform.architecture())"- create environment with
conda env create -f environment.yaml - activate it with
conda activate eye - optional: train the RL agent with
python src/rl/train_agent.py(else it will use the pretrianed agent insrc/rl/models/) - run the game with
python src/app.py.
Avoid obstacles by swaping lanes or jumping over them.
- restart with
rif you hit an obstacle - restart with
shift + rif you want to restart the game during gameplay - toggle eye tracker ON/OFF with
e
- Keyboard controls:
- Left:
a - Right:
d - Jump:
space
- Eye tracking controls
EyeTracking.mp4
- Jump:
space
Click to expand
- Implement eye tracking to control game
- Add RL agent --> train to play the game
- Add ability compete with the RL agent (in the same game)