All posts by vmedved

Body tracking using ORBBEC Astra

The use of augmented reality results in faster recovery of patients who are rehabilitating from accidents like car accident, stroke, etc. which result in impaired movement.

The task was to explore or suggest your own hardware and software solution which would be the most appropriate solution for integration into augmented reality system with the goal of alleviating recovery of patients with reduced motor skills.

It was decided that the best results out of all explored 3D cameras were given by ORBBEC Astra and therefore with Astra SDK, and PCL (Point Cloud Library), skeleton tracking application which displays human was developed. Users are able to choose between joint or human tracking in application menu.

This application can track human joints, human body points, and human body points in color. Human body is segmented from it’s environment using simple technique.

Functionality can be seen in the following video:


Joint tracking using Intel RealSense R200 3D camera

This project’s objective was to discover, test and implement skeletal tracking algorithm, using Intel’s R200 RealSense Camera.

Project to a certain extent implements algorithms using existing Skeletal Tracking Algorithm (Intel RealSense SDK) with 6 body joint points (hands, shoulders, head and spine-mid), send them to a TCP port via socket, as well as render the result with the help of OpenGL.

Current stage of the project is deciding if the Intel’s current cameras are adequate for further improvement and work, or is it more profitable to move on a different piece of hardware.


Authors: Domagoj Makar, Vito Medved

Mentor: izv. prof. dr. sc. Kristijan Lenac