Project summary: Kinect audio

Project „Kinect Audio“ is designed to test the possibilities of the Kinect sensor and thereby make an air drum app. It is made in Visual Studio 2013 community edition, using C# for code behind and Windows Presentation Foundation for the UI.

The application is based on the use of the skeleton stream of Kinect for detecting the user’s skeleton. Each second comes with 30 new frames and for each frame there is detection of the right and the left hand of the user. Furthermore, for each frame lines are drawn, representing the user’s skeleton.

X and Y coordinates of each hand are used to set attributes of an object that is instance of AudioRectangle class. This is the main class where all the logic of the app is and besides hands variables, it has a list of squares that represent the area in which user needs to put his hand to start the audio playback. Each rectangle is connected to its own audio file that represents different drum sound.

When the user presses the space key he enters the mode for changing the position of the rectangles. Then the first two rectangles, in which the user enters, become sticky rectangles and they stick to the position of the user’s hands, till the space key is pressed again. This enables user to arrange rectangles how he likes best. Also, when the user press the J, K or L key, a different song starts to play, so the user can drum along it.

Video of usage is here, and the whole code can be found here.

Project summary: 3D Modelling with DJI Phantom 2 Vision+ quadcopter

Main goal of the project was to create a 3D model of Trsat Castle using quadcopter and available applications.

This was achieved using DJI’s Phantom 2 Vision+ quadcopter with Pix4D Mapper Pro application (for PC). Gathered dataset of images (around 400) was collected by manual flight over Trsat Castle using DJI Vision mobile application. Furthermore, mobile application Pix4D Capture helped us to achieve autonomous flight and gather extra geotagged images needed for construction of 3D model.


Project participants:
Domagoj Poljančić
Bojan Filipović