CSC 2524 Topics in Interactive Computing:
Graphics, Interaction and Perception in
Augmented and Virtual Reality AR/VR
NOTE: The class will meet once a week R 2-4pm in the DGP lab BA B5187.
Professor: Karan Singh (http://www.dgp.toronto.edu/~karan)
...this course will explore aspects of perception, graphics, interaction and creation in the immersive setting of augmented and virtual reality AR/VR. This course is designed to serve three purposes:
-
to teach students the fundamental principles behind technology, perception and navigation in AR and VR.
-
to allow students to build creative AR/VR prototypes using 3D scanners, motion capture and AR/VR devices.
-
to read, understand and present state of the art research papers in AR/VR.
As a graduate course in the Department of Computer Science, a solid background in computer science is expected. A background in computer graphics, HCI and an artistic sense are useful. The course format is 12 weeks of one meeting a week. Roughly 1/2 the meetings will be lectures and the rest will be tutorials, demos and paper presentations by students. The students will be graded on their technical and creative contribution to an AR/VR project (done in groups of 3 or less) that will account for 40% of the grade. A project report will account for 10% of the mark (many of these may turn into publications). A small immersive experinece or perception experiment (groups of 3 or less) will be worth 25%. The remaining 25% will be based on the presentation of a research paper in class.
This term, the class will have significant interaction with an interdisciplinary art and theater course:
DRA3907HY Collisions and Common Ground: art - technology - performance.
Specifically students will be able to work on course projects that contribute to a mutimedia performance of the Tempest, by William Shakespeare.
Discussion of areas of particular interest for production:
- The Storm (opening scene)
- The Island (focussing on the representation of the island in one of various scenes throughout the play)
- Ariel (focussing on the representation of Ariel and his ‘magical’ works on behalf of Prospero)
READINGS: Read the entire text of the play OR
Read summaries of all acts (Act I - Epilogue): http://www.sparknotes.com/shakespeare/tempest/
Grading scheme
- immersive experience prototype or perception experiment 25%.
- paper presentation 25%.
- project 40% + report (1-4 pages) 10% (a mid-term evaluation will be worth 10 of the 40%).
Duration
First class will meet 13 Sept. 2018. The class will meet once a week R 2-4pm in the DGP lab BA B5187.
Schedule
Week # |
Slides, reading material |
Topics covered |
1 |
welcome, introduction to AR/VR |
introduction to course, overview of AR/VR, AR/VR technology and platforms. slides |
2 |
creative prototypes/experiments and introduction to the Tempest. |
introduction to Unity, Unreal, JanusVR and other authoring platforms, introduction to the Tempest and DRA3907HY. Guest Speakers: Pia Kleber and David Rokeby. VR Optics and prospective project slides |
3 |
AR/VR for design, project discussion |
|
4 |
perceptual principles of AR/VR |
|
5 |
|
student project presentations |
6 |
UI and interaction for AR/VR |
|
7 |
navigation and interaction AR/VR |
student paper presentation (Eleni) |
8 |
|
|
9 |
|
student paper presentations |
10 |
|
student paper presentations |
11 |
|
student paper presentations |
12 |
|
Conclusion and Final Project Presentations |
Software Game engines, environments and authoring tools
Devices available: rift, vive, hololens, gearVR, cardboard, daydream, homido, ricoh-360.
Software: JanusVR, Unity, Unreal, ARKit, ARCore.
Projects
1. Tempest project (Prospero, Proprioception and Painting) |
2. DancAR. |
3. Exploring Latent Spaces in VR. |
4. Direct manipulation and browsing of linked 360 images, and video. |
Papers (to be presented)
|
|
|
|
|
|
|
|
|
|
|
|
|
|