What is the main goal for this project? 

In the field of Augmented Reality important it is to have solution to interact with. We developed in the past solutions catching and elaborating point clouds using Lidar sensors or low cost infrared sensors.

Now the goal is to develop an application that:

-recognizes an object under view among a list of CAD models

-tracks the position and orientation of the object in the space realtime (6DoF)

But the experimental job is to get information only from multiple simple RGB cameras. Then we need to add some 3D models to animate some scenes

We prefer to have the application written in Python or C++ using open libraries.

The application will have few simple features to make it works: i)upload 3D models, ii)calibrate the system of cameras, iii)starting/stop buttons; iv)create a scene; v) etc...

What tasks will learners need to complete to achieve the project goal? 

Develop an application in team, so the team has to deliver a software application (each student can take a part):

• get 3D environment from multiple camera streaming signals
• recognize objects in a database of 3D objects
• real time tracking of the object
• develop the possibility to create a scene with virtual objects (3D models) in the scene
• UI to make the system more user-friendly

How will you support learners in completing the project? 

The teams will be supported with:

• chat to exchange data, information, project management and progress check
• suggestions with libraries to use
• repository of the code under development
• test and feedback
• weekly meeting with a coordinator in the company

What skills or technologies will help learners to complete the project? 

• python
• c++
• openCV