Introduction
Psychologists see blocks as a great tool for mental development due to its two main features involved in the block-building process: 1) Instruction following and 2) abandoning instructions and make own creations. Therefore, a mixed reality application for hololens, mimicking a 3D sandbox will the developed. The application is going to consist of both functionalities will be developed. With the combination of the reality and virtual reality, users can introduce an extra factor of space to make their creation more dynamic.
Objective
In this project, A 3D mixed reality sandbox application for hololens is to be developed. The overall objective would be developing an interactive sandbox that focuses on user experience and allowing users to fully utilize their ability to make creations of their own. As mentioned in the introduction, the application will include two main features, and the two features will correspond to the two main phases of the application development.
Phase 1 objective [Create]
- Create blocks of different texture and store in hololens for users to use
- Extract textures from reality and create blocks of the respective texture
- Select preferred building blocks
- Place or attach blocks onto reality surfaces or walls, or onto other blocks
Phase 2 objective [Instruction following]
- Allow users to scan real life models for block-building reference
- Dissect scanned models into units of blocks
- Allow users interact with scanned model in terms of each block scanned
- Allow users to get clear view on how to build a model which is physically similar to the one being scanned
Project Details
Supervisor
Dr. Loretta Choi
Release Platform
Hololens
Development Tools
Unity, Mineways, MixedReality Toolkit-Unity, Leap Motion Interactive Module