Body tracking using ORBBEC Astra

The use of augmented reality results in faster recovery of patients who are rehabilitating from accidents like car accident, stroke, etc. which result in impaired movement.

The task was to explore or suggest your own hardware and software solution which would be the most appropriate solution for integration into augmented reality system with the goal of alleviating recovery of patients with reduced motor skills.

It was decided that the best results out of all explored 3D cameras were given by ORBBEC Astra and therefore with Astra SDK, and PCL (Point Cloud Library), skeleton tracking application which displays human was developed. Users are able to choose between joint or human tracking in application menu.

This application can track human joints, human body points, and human body points in color. Human body is segmented from it’s environment using simple technique.

Functionality can be seen in the following video: