Visual aid is an integral part of presentation. Presenters utilize visual aid to improve comprehensiveness and to make their presentation more impactful. The most popular kind of visual aid is presentation slides. However, it is difficult to integrate slides into the presentation well due to the separation between the slides and the presenters. The problem gets worse as the popularity of E-learning increases, where more presentations will be conducted through the Internet. In the video, presenter and slides cannot be shown together, which may cause confusion to the audiences.
By using augmented reality in presentation, presenters and visual aid will both become a part of the scene. According to a journal investigating interactive marketing, comparing to web-based product presentations, AR-based product presentations are said to be providing more effective communication benefit. Audience’s purchase intention and immersion is enhanced through enjoyment and excitement in AR experience [1]. Presenters can treat the elements in a presentation slides, such as text and images, as if they were real objects on the stage, which leads to a more coherent experience to the audience.
Despite the maturity of augmented reality technologies, only large scale campaign or conference use AR technology (See Figure 1). There is nearly no presentation software which incorporates such technologies. Therefore, our team decided to develop a presentation software which focuses on augmented reality.
Figure 1 Screenshot from a news report
PowerPoint creates presentation slides which is displayed page by page. Users can quickly design an aesthetically pleasing slides using its built in templates. Users can also apply animations on text, images and transition between slides.
Starting from PowerPoint 2016, users can also add 3D objects to the presentation. Rotation can be made to the model during the presentation to show different features of the object [2].
The disadvantage with PowerPoint is that it does not produce memorable presentation slides. Templates may appears to be too boring and it sometimes prevents text from standing out. Animation and sound may distract rather than impress audience [3]. PowerPoint also work poorly when the presentation is recorded since only one of the presenter and the slides can be shown at a time. Video editing have to be done to show both simultaneously.
Prezi create presentation slides based on zooming in and out on a giant canvas. This provides more room for users to design unique presentation slides. Like Microsoft PowerPoint, it does not work in recorded presentation well. However, Prezi is planning to add augmented reality functionality to their product, which overlays the slides on the video [4].
Although this functionality has not been released yet, there are some possible limitations shown in their previews. First, the images do not react to speakers’ gesture. Also, the images are always on top of the video, so it may look unnatural when part of the images are supposed to appear behind the speaker.
Nissan has used augmented reality in their presentation of Nissan Teana during the Guangzhou Auto Show [5]. They used it to present the internals of the car. Compared to showing the objects in a presentation slides, this is more immersive and will give a more believable experience to the audience.
Similar presentations can also be be found elsewhere, but it is often seen in big events done by professional. Our team hope to enable ordinary users to make use of augmented reality to enhance the visuals used in their presentations.
Our team want more people to learn and promote the benefits of augmented reality. Our final product allows user to add 3d objects into presentation and using AR technology to visualise the object. Therefore, our product will provide ways for user to build their 3d objects. At first, we would like implement 3d models import function that are created by third-party software. Moreover, we will explore the internet if there is any free 3D model library which provides API call. If there is an option, we can include a list of 3D models in our application. Furthermore, if there is sufficient time and resource, we would like to implement 3D scanning function in our app.
In order to create a presentation using augmented reality technology in a convenient way, our team decided to build a mobile application as our product. In the application, we expect the interface to be user-friendly which people can build their own AR presentation even they are not experienced with AR or new to our application. Therefore, comprehensive guidelines to the functionalities of our app should be included. Moreover, 3D models, text, image, and graph presets should be included in the application to ease the speed of constructing the presentation.
Through our investigation, we categorised two different use cases when using our application: live presentation and online presentation. Both of the use cases require different features. During the project development, features will For live presentation, screen sharing to external display devices is required and remote control device is required. For online presentation, video recording is required.
Augmented reality does appear in current presentations. However, to make it popular among ordinary users, there are some problems which need to be solved.
Using 3D models in presentation is unfamiliar to the general public. The user interface of our program should not be cluttered with options which are rarely used. By having a cleaner interface, users may find it easier to learn how the program function.
One major benefit of using augmented reality in presentation is to give audience an immersive experience. Therefore, images must appear to be a natural addition to the video. To meet this requirement, our team have to find ways to calculate accurate lighting and to handle occlusion between real and virtual objects.
To fully utilize the augmented reality capabilities of the software, 3D models should be used. However, 3D models can be difficult to make. Users may want to download ready made models from the Internet and use them in their presentation. In order to simplify this process, our team will explore the possibility of offering model downloads from some 3D model repositories directly in the program.
We proposed to build a mobile application in iOS platform. Our target user is iPad user who needs to deliver a presentation. Users can be:
Teacher
Presenter
Content creator using video-sharing platform
For live presentation, we also proposed to build a remote control app to control the slides during presentation. The device and remote control is planned to be connected by bluetooth.
There are two major use cases:
Live view presentation
Video presentation
Figure 2 shows the basic flow when user is using the application.
Figure 2 Basic flow of our application
User can create a presentation slide from scratch in our application. During presentation creation, user can add different element into each slides such as 3D models, text, image or graph. User can also input the stage dimensions and the initial position and direction of the tablet, which will be used as a camera during a presentation.
While user is presenting, sometimes the presenter may want show the 3D object or graph which may use up a large portion of space and therefore, they need the camera to view their body and leave a lot space for presentation. However, presenter sometimes may not need visual aid and wish the audience focus on their facial expression or speech. Therefore, a close-up view on their face is also essential for presenting. As usual, we need two cameras in order to achieve these functions. We want to simplify these function by using only one camera. To include this feature, we will implement some computer vision technique to keep track on presenter face and the camera can zoom in to presenter’s face and move accordingly.
Users can import their own 3d models into the slides. The application should support popular 3D model formats such as .fbx and .obj. It should also support the retrieval of 3D models from cloud storage services such as Google Drive and Dropbox.
Users can record their presentation and export to various formats such as .mp4 and .avi. In the video, both presenter and the visual aid will be included so that viewers will get the full experience. Users are also given the chance to re-record parts of their presentation. In the recording mode, screen will display a dialog on the screen with the reminder of the next slide to enrich user experience.
In case of a live presentation, users can control the presentation slides with a remote control app that pairs with the iPad showing the slides.
For app development framework, we are going to use Microsoft Visual Studio Development Environment along with Unity Framework. For augmented reality library, Vuforia engine in Unity will be used to create AR objects.
30 September 2018 |
Deliverables of Phase 1 (Inception) • Detailed project plan • Project web page |
7-11 January 2019 |
First presentation |
20 January 2019 |
Deliverables of Phase 2 (Elaboration) • Preliminary implementation • Detailed interim report |
14 April 2019 |
Deliverables of Phase 3 (Construction) • Finalized tested implementation • Final report |
15-19 April 2019 |
Final presentation |
29 April 2019 |
Project exhibition |
The team will be adhering strictly to the timeline. After the deliverable of phase 1, deadline has been allocated to each stage of the project is as follows:
Determining the scope of the project - 20 Oct
Analysis of the hardware, and software such as APIs and frameworks - 20 Oct
Design and Development of a functional prototype with basic scanning and visualization features - 30 Nov
Development of first demo of the application - 31 Dec
Documentation for first demo - 7 Jan
Development of second demo of the application - 31 Jan
Documentation for second demo - 15 Feb
Development of final product - 17 Mar
Integration Testing - 30 Mar
Documentation and final report - 12 Apr