16-823: Appearance Modeling, Fall 2005
General Information
Time :
Mondays and Wednesdays, 1:00 pm -- 2:20 pm
Location: Scaife Hall 125, (the ECE Seminar auditorium)
Credits : 12
Pre-requisites : Linear Algebra, Calculus, Undergraduate or Graduate level Vision or Graphics
Announcements
- [October 02] Deadlines:
Midterm Project Presentations : Monday October 24
Midterm Assignment : Out Wednesday October 26, Due 1pm, Wednesday November 9
[PDF]
Photography Competition : Extended to Monday November 21 (due to CVPR deadline)
Final Project Presentations : Monday December 5
Final Exam : Wednesday December 7 (tentative)
- [September 9] Lecture
presentations will be posted here a week after the class.
Scroll down the webpage for the posted lectures.
-
[September 1] If you are just
auditing the course, please register for pass/fail.
-
[September 1] Please email
instructor the teams (of two) for the research project.
Instructor
Srinivasa Narasimhan
http://www.cs.cmu.edu/~srinivas
Email:
srinivas@cs.cmu.edu
Office: NSH 4117
Office Hours: By appointment
Overview
Everyday we observe an extraordinary array of light and color phenomena
around us, ranging from the dazzling effects of the atmosphere, the
complex appearances of surfaces and materials and underwater scenarios.
For a long time, artists, scientists and photographers have been
fascinated by these effects, and have focused their attention on capturing
and understanding these phenomena. In this course, we take a computational
approach to modeling and analyzing these phenomena, which we collectively
call as "visual appearance". The first half of the course focuses on the
physical fundamentals of visual appearance, while the second half of the
course focuses on algorithms and applications in a variety of fields such
as computer vision, graphics and remote sensing and technologies such as
underwater and aerial imaging.
This course is an initial attempt to unify concepts usually learnt in
physical sciences and their application in imaging sciences. The course
will also include a photography competition in addition to analytical
and practical assignments.
List of Topics
- Fundamentals of Appearance
- Principles of Photometry
- Light Fields
- Reflection, Refraction, Polarization, Diffraction, Interference
- Surface Reflection Mechanisms
- Signal Processing framework for Reflection
- Textures and Spatially Varying BRDFs (BTF)
- Lighting and Shadows
- Interreflections
- Caustics
- Scattering and Volumetric Light Transport
- Fluids
- Algorithms and Applications
- Photometric 'Shape-from-X' algorithms
- Image and Vision-based Rendering
- Monte Carlo Simulations
- Appearances of Transparent, Transluscent, Wet, Woven surfaces
- Appearances of Atmospheric and Underwater scattering effects
- Appearances of Fluids - smoke, fire, water
- Vision in Bad Weather
- Applications in Aerial, Underwater, Medical and Microscopic Imaging
- Principles of Nature Photography
Optional Texts
- Robot Vision, B. K. P. Horn, MIT Press, 1986
- Light and Color in the
Outdoors, M. Minnaert.
Grading
- One Assignment 30%
- One Project 40%
- One Exam 15%
- Photography competition 15%
Lecture Presentations
[Acknowledgements]
A significant part of this course is similar to the courses offered at
Stanford (Pat Hanrahan, Marc Levoy, Ron Fediw), UC San Diego (Henrik Wann
Jensen), Columbia (Shree Nayar, Peter Belhumeur, Ravi Ramamoorthi), UW
Madison (Chuck Dyer), UWash (Steve Seitz), Utah (Pete Shirley), Rutgers
(Kristin Dana), Cornell (Steve Marschner, Kavita Bala), Technion (Yoav
Schechner), Princeton (Szymon Rusinkiewicz), MIT (Ted Adelson), Ko Nishino
(Drexel), Rahul Swaminathan (Deutsch Telecom). The instructor thanks the
instructors of these courses for the materials (slides, content) used in
this course. In addition, several photographs and illustrations are
borrowed from internet sources. The instructor thanks them all.
[Permission to use/modify materials]
The instructor gladly gives permission to use and modify any of the
slides for academic and research purposes. Since a lot of the material is
borrowed from other sources, please acknowledge the original sources too.
Finally, since this is a continuously evolving course, all suggestions
and corrections (major, minor) are welcome!
WEEK 1: INTRODUCTION
- Lecture 1: Introduction + Course Administration
[PPT]
- Lecture 2: Basic Principles of Imaging and Photometry
[PPT]
WEEKS 2,3,4: SURFACE REFLECTANCE
- Lecture 3: Basic Principles of Surface Reflectance
[PPT]
- Lecture 4: BRDF Models for Rough Specular Surfaces
[PPT]
- Lecture 5: BRDF Models for Rough Diffuse Surfaces
[PPT]
- Lecture 6: BRDF Measurements
[PPT]
- Lecture 7: Signal Processing Framework for Surface Reflection in 2D
[PPT]
(See Prof. Ramamoorthi's homepage .)
- Lecture 8: Signal Processing Framework for Surface Reflection in 3D
[PPT]
WEEKS 5,6,7: LIGHTING, SHADOWS AND INTERREFLECTIONS
- Lecture 9: Lighting and Shadows I
[PPT]
- Lecture 10: Lighting and Shadows II
[PPT]
- Lecture 11: Interreflections I
[PPT]
- Lecture 12: Interreflections II
[PPT]
(Online PPTs of
Steve Seitz
and Marc Levoy).
- Lecture 13: Precomputations for Rendering I - Deformation/Collision
modeling
(Special Lecture by Doug James)
- Lecture 14: Precomputations for Rendering II - Light Transport
(Online PPTs of
Peter-Pike Sloan,
and Ren Ng)
WEEK 8: REFLECTION AND REFRACTION
- Lecture 15: Basic Principles of Reflection, Refraction and Caustics
[PPT]
- Lecture 16: Caustics in Imaging and Rendering
[PPT]
(Thanks to PPTs from Ko Nishino and Rahul Swaminathan)
WEEK 9: LIGHT POLARIZATION
- Lecture 17: Basic Principles of Light Polarization
[PPT]
(Thanks to PPTs from Yoav Schechner)
- Lecture 18: Applications of Light Polarization in Computer Vision
[PPT]
(Thanks to PPTs from Yoav Schechner)
WEEK 10, 11: LIGHT SCATTERING
- Lecture 19: Basic Principles of Light Scattering
[PPT]
- Lecture 20: Volumetric Light Scattering in Computer Vision
[PPT]
- Lecture 21: Volumetric Light Scattering in Computer Graphics
[PPT]
WEEK 12: FLUIDS: SMOKE, FIRE AND WATER
- Lecture 22: Basic Principles of Modeling Fluids
[PPT]
WEEK 13: MISC OPTICAL PHENOMENA: DIFFRACTION, INTERFERENCE
WEEK 14: PRINCIPLES OF NATURE PHOTOGRAPHY