Augmented and Virtual Reality

CSC 2524 Topics in Interactive Computing:
Graphics, Interaction and Perception in
Augmented and Virtual Reality AR/VR

Professor: Karan Singh (http://www.dgp.toronto.edu/~karan)

...this course will explore aspects of perception, graphics, interaction and creation in the immersive setting of augmented and virtual reality AR/VR. This course is designed to serve three purposes:

to teach students the fundamental principles behind technology, perception and navigation in AR and VR.
to allow students to perform perception and interaction experiments and build creative prototypes using 3D scanners, motion capture and AR/VR devices.
to read, understand and present state of the art research papers in AR/VR.

As a graduate course in the Department of Computer Science, a solid background in computer science is expected. A background in computer graphics, HCI and an artistic sense are useful. The course format is 12 weeks of one meeting a week. Roughly 1/2 the meetings will be lectures and the rest will be tutorials, demos and paper presentations by students. The students will be graded on their technical and creative contribution to an AR/VR project (done in groups of 3 or less) that will account for 40% of the grade. A project report will account for 10% of the mark (many of these may turn into publications). A small immersive experinece or perception experiment (groups of 3 or less) will be worth 25%. The remaining 25% will be based on the presentation of a research paper in class.

Grading scheme

perception experiment 25%.
paper presentation 25%.
project 40% + report (1-4 pages) 10% (a mid-term evaluation will be worth 10 of the 40%).

Duration

First class will meet 14 Sept. 2017. The class will meet once a week R 3:30-5:30 in BA 5187, the Dynamic Graphics Project lab (http://www.dgp.toronto.edu).

Schedule

Week #	Slides, reading material	Topics covered
1	welcome, introduction to AR/VR	introduction to course, overview of AR/VR, AR/VR technology and platforms
2	VR optics	optical principles in AR/VR.
3	navigation and interaction AR/VR, project discussion	3D navigation and interaction principles..
4	UI for AR/VR	input and interfaces for AR/VR.
5		student paper presentations
6		student paper presentations
7	spatio-temporal perception in AR/VR Transitioning VR <=> AR	perceptual issues in AR/VR
8		student paper presentations
9	creation and cinematography in AR/VR	AR/VR filmmaking
10		student paper presentations
11		student paper presentations
12		Conclusion and Final Project Presentations

Software Game engines, environments and authoring tools

Devices available: rift, vive, hololens, gearVR, cardboard, daydream, homido, ricoh-360.

Software: JanusVR, Unity, Unreal, ARKit.

Projects

1. Interactive 3D acquisition and scanning of large spaces with AR.

2. Navigation and interaction in small physical spaces using props.

3. Exploring the virtual-physical disconnect in VR.

4. Developing a cinematic vocabulary for 360 video in VR.

5. Direct manipulation and browsing of linked 360 images and video.

6. Hands of Shiva, proprioception in AR/VR.

7. Depth and size perception in AR/VR.

8. Immersive platform for language and cultural exchange.

9. Propose a project.

Papers (to be presented)

CSC 2524 Topics in Interactive Computing: Graphics, Interaction and Perception in Augmented and Virtual Reality AR/VR

CSC 2524 Topics in Interactive Computing:
Graphics, Interaction and Perception in
Augmented and Virtual Reality AR/VR