This repository contains the implementation for the project: Depth-aware Mixed Reality: Capture the AR-Flag. The project's goal is to augment reality with a virtual object which can be interacted with by multiple people. It is split into multiple parts which are listed and whose progress is displayed in Progress. This project was done in the context of the lab course - perception and learning in robotics and augmented reality.
- Depth Estimation and Camera Pose
- Depth Map Filtering
- Kinect Fusion Integration
- User Interaction and Scene Manipulation
- ChArUco Marker Tracking
- Human Pose Estimation
- Realism and Embedding
- Augmented Rendering
- Image Harmonization
- (Extension) Multiplayer Game: Capture the plane
The project depends on the following libraries:
- OpenCV with ArUco contrib module
- Caffe
- Pytorch
- Pyrender
A video showcasing our implementation:
The intermediate slides presenting the project can be seen here. For the final slides go here.