EN.601.454/654 Augmented reality (Spring 2022)


Lecturers:
Prof. Nassir Navab and Prof. Ehsan Azimi

Time and Venue:
In-person: Mons and Weds from 8:30- 9:45 AM EST at Hodson 316.

Zoom: 997 6845 5195. Registration details on Blackboard.


Recommended Course Background:
EN.601.220: Intermediate Programming or equivalents
EN.601.226: Data Structures or equivalents
AS.110.201/212: Linear Algebra or equivalents

Reference Textbooks:

  • Augmented reality: principles and practiceDieter Schmalstieg, Tobias Höllerer. Boston: Addison-Wesley [2016] (You can borrow it or access it online with our library resource: link)
  • Multiple View Geometry in Computer VisionRichard Hartley, Andrew Zisserman. New York: Cambridge University Press [2003] (You can borrow it or access it online with our library resource: link)


Office Hours:
Prof. Nassir Navab and Prof. Ehsan Azimi: by appointment

Before Spring Break:
Wei-Lun Huang: Thursday, 4:30 pm to 6:00 pm on Zoom (link is posted on Blackboard).

Sing Chun Lee: Friday, 8:30 am to 10:00 am at Malone 216.

Yihao Liu: Friday, 5:45 pm to 7:15 pm at Malone 216.


After Spring Break: Meet your tutors regularly by appointment!


Course Materials: They are available on Blackboard


Tentative Schedule (topics and speakers may change):

#DateTopicSpeakersRemarks
11/24 (Mon)Introduction to AR & Course LogisticsNassir Navab,
Ehsan Azimi
Assignment 0 (Submission Logistics) – Release
21/26 (Wed)Introduction, Transformations and Coordinate SystemsNassir Navab 
31/31 (Mon)Transformations, Parameter EstimationNassir NavabAssignment 0 – Due: 1/31, 08:30 am (before class)

Assignment 1 (Transformations, Parameter Estimation) – Release
42/02 (Wed)Parameter EstimationNassir Navab 
52/07 (Mon)Camera Models and Projection MatricesNassir Navab
62/09 (Wed)Camera CalibrationNassir Navab Assignment 1 – Due: 2/09, 08:30am (before class)

Assignment 2 (Camera Models, Camera Calibration) – Release
72/14 (Mon)Head-mounted Displays, Calibration and Applications Ehsan Azimi
82/16 (Wed)Medical Augmented Reality Nassir Navab Assignment 2 – Due: 2/16, 08:30am (before class)

Assignment 3 (HMD, Perception) – Release
92/21 (Mon)Visual System and PerceptionAlejandro Martin-Gomez
102/23 (Wed)Sonic Interaction Design in the Context of Medical Intervention Sasan Matinfar Assignment 3 – Due: 2/23, 08:30 am (before class)

Research Assignment – Release

Check the zoom link posted on Piazza.
112/28 (Mon)Design Thinking, User Interaction, and Input DevicesEhsan Azimi
123/02 (Wed)Tutorial Session: Introduction to UnitySing Chun LeeMock Exam – Release

This is a hands-on session. Remember to bring your laptop with you. Also, please follow the installation guideline (posted on Blackboard) to install Unity before class. It takes almost an hour for installation.
133/07 (Mon)Managing Spatial Relations in Augmented Reality ApplicationsNassir Navab

143/09 (Wed)Guest Lecture from Siemens HealthineersAli KamenResearch Assignment – Due 3/09, 11: 59 pm Due 3/10, 11:59 pm

Mock Exam Solution – Release
153/14 (Mon)Midterm ExamIn-class midterm Exam: 3/14
163/16 (Wed)Projects IntroductionNassir Navab, Ehsan AzimiProject team enrollment – Due 3/18 (Fri) 11:59 pm
173/21 (Mon)No ClassesSpring Break
183/22 (Wed)No ClassesSpring Break
193/28 (Mon)Project DevelopmentMeet your mentor(s) and prepare your kickoff presentation
203/30 (Wed)Kickoff PresentationPresentation submission due: 3/29 11:59 pm
In-class presentation: 3/30
214/04 (Mon)Project DevelopmentMeet your mentor(s) and make progress on your AR project
224/06 (Wed)Project DevelopmentMeet your mentor(s) and make progress on your AR project
234/11 (Mon)Project DevelopmentMeet your mentor(s) and make progress on your AR project
244/13 (Wed)Project DevelopmentMeet your mentor(s) and make progress on your AR project
254/18 (Mon)Storytelling.
Preparing your Project Demo
Meet your mentor(s) and finalize your AR project
264/20 (Wed)Preparing your Project DemoMeet your mentor(s) and finalize your demo
274/25 (Mon)Finalize your project and demoMeet your mentor(s) and finalize your demo
284/27 (Wed)Finalize your project and demoMeet your mentor(s) and finalize your demo
295/9 (Mon)Final Project SubmissionSubmission Deadline
305/11 (Wed)Final Project DemoTo be confirmed. Tentative time: 6 pm – 9 pm and venue: Hackerman B08.