CSC 2521 Calendar (Fall 2003)

Calendar

Note that the future schedule is subject to change. We won't cover every single topic or paper listed on this page.

Date	Topic	Readings
September 8	Introduction and Overview
September 10	Statistics, probability, and Bayesian Reasoning Multinomial densities Gaussian distributions	MacKay, sections 2.1-2.3; 22.1
September 15	Mixture models K-means clustering Mixtures of Gaussians Project 1 hand-out	MacKay, chapter 20, chapter 22 Related reading: Bishop handout on PCA
September 17	EM for MoGs Paper presentation and discussions	V. Blanz, T. Vetter. A Morphable Model for the Synthesis of 3D Faces. SIGGRAPH 99. Website [Azeem L.] Related readings (optional): M. Kirby and L. Sirovich. Application of the k-l procedure for the characterization of human faces. IEEE Transc. On Pattern Analysis and Machine Intelligence, 12(1):103--108, Jan. 1990. paper M. Turk and A. Pentland, "Face recognition using eigenfaces," CVPR 1991. paper T.F. Cootes and C.J. Taylor, "Statistical models of appearance for medical image analysis and computer vision", Proc. SPIE Medical Imaging 2001. website paper S. Romdhani and T. Vetter. Efficient, Robust and Accurate Fitting of a 3D Morphable Model. ICCV 2003. website
September 22	Paper presentations and discussion	V. Blanz, C. Basso, T. Poggio, T. Vetter. Reanimating Faces in Images and Video. Eurographics 2003. paper, Video 1, Video 2 . [Greg P.] B. Allen, B. Curless, Z. Popović. The Space of all body shapes and sizes. SIGGRAPH 2003. website [Hanieh B.] Y.-Y. Chuang et al. A Bayesian Approach to Digital Image Matting. website. CVPR 2001. [Alex K.] Related reading Y.-Y. Chuang et al. Video Matting of Complex Scenes. SIGGRAPH 2002. website
September 24	Derivation of EM for MoGs, and advanced topics Guest lecture: Brendan Frey	Related readings R. M. Neal and G. E. Hinton. A View of the EM Algorithm that Justifies Incremental, Sparse, and Other Variants. paper MacKay, chapter 33 M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, L.K. Saul. An Introduction to Variational Methods for Graphical Models. paper B. J. Frey and N. Jojic. Advances in Algorithms for Inference and Learning in Complex Probability Models. paper
Sep 29, Oct 1	Hidden Markov Models	L. R. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proc. of the IEEE, Vol.77, No.2, pp.257--286, 1989. You only need to read up to page 276, and page 282 (Sections I-III and V.A) paper (accessible from on-campus) Related Reading Z. Ghahramani. An Introduction to Hidden Markov Models and Bayesian Networks. IJPRAI. Vol 15, No 1, 2001, p. 9. paper
Oct 6	Paper presentation and discussion	C. Bregler, M. Covell, M. Slaney. SIGGRAPH 97. Video Rewrite: Driving Visual Speech with Audio. webpage [Marge C.] M. Brand. Voice Puppetry. SIGGRAPH 99. website paper. video clip [Kevin F.] M. Brand and A. Hertzmann. Style Machines. SIGGRAPH 2000. website [Winnie T.] Related reading J. B. Tenenbaum, W. T. Freeman. Separating style and content with bilinear models. Neural Computation 12 (6), 1247-1283. website paper
Oct 8	Paper presentation and discussion	T. Ezzat, G. Geiger, T. Poggio. Trainable Videorealistic Facial Animation. SIGGRAPH 2002 webpage [Eron S.] O. Arikan, D. Forsyth. Interactive Motion Generation from Examples. SIGGRAPH 2002. webpage [Steven R.] J. Lee et al. Interactive Control of Avatars Animated with Human Motion Data. SIGGRAPH 2002. webpage [Mike P.] Related readings Schödl et al. Video Textures. SIGGRAPH 2000. webpage Pullen and Bregler. Motion Capture assisted Animation: Texturing and Synthesis. SIGGRAPH 2002. paper Kovar et al. Motion Graphs. SIGGRAPH 2002. webpage Li et al. Motion Texture. SIGGRAPH 2002.
Oct 13	Holiday
Oct 15	Interpretation of Bayes Rule Marginalization vs. maximum likelihood Graphical models Markov Random Fields Belief Propagation Assignment due	MacKay, chapter 21 skim MacKay, chapter 24 J. S. Yedidia, W. T. Freeman, Y. Weiss. Understanding Belief Propagation and its Generalizations. website paper Read Sections 1-1.2, and all of Section 2.
Oct 20	Variational methods KL-divergence Free energy EM Variational Learning Loopy Belief Propagation	M. I. Jordan, Z. Ghahramani, T. S. Jaakkola, L.K. Saul. An Introduction to Variational Methods for Graphical Models. paper. Sections 4-4.2, 6-6.2 Yedidia, Sections 3-3.1 Recommended reading R. M. Neal and G. E. Hinton. A View of the EM Algorithm that Justifies Incremental, Sparse, and Other Variants. paper Related reading MacKay, sections 33.1, 33.4-33.7 Rest of the Yedidia paper
Oct 22	Paper presentations and discussions	Y. Weiss. Deriving intrinsic images from image sequences. ICCV 2001. paper [Vladimir J.] A. Levin, A. Zomet and Y. Weiss. Learning to perceive transparency from the statistics of natural scenes. NIPS 02. paper, animation [Roland M.] M. F. Tappen, W. T. Freeman, E. H. Adelson. Recovering Shading and Reflectance from a Single Image. NIPS 02. paper [Hanieh B.] Related reading G. D. Finlayson, S. D. Hordley, M. S. Drew. Removing Shadows from Images. ECCV'02 Vol.4, Lecture Notes in Computer Science Vol. 2353, pp. 823-836, 2002. paper Levin A., Zomet A. and Weiss Y. Learning How to Inpaint from Global Image Statistics. ICCV 2003. paper M. F. Tappen, B. C. Russell, and W. T. Freeman, Exploiting the sparse derivative prior for super-resolution and image demosaicing, 3rd Intl. Workshop on Statistical and Computational Theories of Vision (associated with Intl. Conf. on Computer Vision), Nice, France, October, 2003. paper papers on natural image statistics
Oct 27	No class today
Oct 29	Regression and classification k-nearest keighbors Neural networks RBFs SVMs	MacKay, chapters 38, 39, 44. Bishop, p. 164-175 Related reading Bishop, p. 77-97, 116-132, 140-146 (handed-out in class) MacKay chapters 40-43 C. J. C. Burges. A Tutorial on Support Vector Machines for Pattern Recognition. 1998 paper, more tutorials R. E. Schapire. The boosting approach to machine learning: An overview. In MSRI Workshop on Nonlinear Estimation and Classification, 2002. paper
Nov 3-5	Paper presentations and discussion	P.-P. Sloan, C. Rose, M. F. Cohen. Shape by Example. 2001 Symposium on Interactive 3D Graphics, March, 2001. paper [Greg P.] C. F. Rose III, M. Cohen, B. Bodenheimer. Verbs and Adverbs: Multidimensional Motion Interpolation. IEEE CG&A. website [Greg P.] R. Grzeszczuk, D. Terzopoulos, G. Hinton. NeuroAnimator: Fast Neural Network Emulation and Control of Physics-Based Models. SIGGRAPH 98. website, paper. [Azeem L.] P. Faloutsos, M. van de Panne and D. Terzopoulos Composable Controllers for Physics-based Character Animation. SIGGRAPH 2001. website paper [Mike N.] Related reading J. P. Lewis. Pose-space deformations. SIGGRAPH 2000. C. F. Rose III, P.-P. Sloan, M. Cohen. Artist-Directed Inverse Kinematic Using Radial Basis Function Interpolation. Eurographics 2001. website R. Grzeszczuk, D. Terzopoulos and G. Hinton. Fast Neural Network Emulation of Dynamical Systems for Computer Animation, in Advances in Neural Information Processing Systems: Proceedings of the 1998 Conference (NIPS11), MIT Press, pp.882-888. Jones-Viola face detector B. Allen, B. Curless, Z. Popović. Articulated body deformations from range scans. SIGGRAPH 2002. webpage, paper O. Arikan et al. Motion synthesis with annotations. SIGGRAPH 2003. website P. Sand, L. McMillan, J. Popović. Continuous Capture of Skin Deformations. SIGGRAPH 2003. website
Nov 5	Monte Carlo	MacKay, sections 29-29.4, 29.8-29.10, 30.1 Related reading Rest of chapters 29-32 R. M. Neal, Probabilistic Inference Using Markov Chain Monte Carlo Methods, Technical Report CRG-TR-93-1, University of Toronto. 1993. webpage
Nov 10	Paper discussion and presentation	S. Chenney and D.A.Forsyth, "Sampling Plausible Solutions to Multi-Body Constraint Problems". SIGGRAPH 2000 Conference Proceedings, pages 219-228, July 2000. website [Patrick C.] M. Anderson, E. McDaniel, S. Chenney. Constrained Animation of Flocks. SCA 2003. website [Bowen H.] Eric Veach and Leonidas J. Guibas. Metropolis Light Transport. SIGGRAPH 97 Proceedings, pp. 65-76. website [Vladimir J.] Related reading R. Barzel, J. Hughes, D. Wood. Plausible Motion Simulation for Computer Graphics Animation. CAS 96. website. J. Kajiya. The Rendering Equation. SIGGRAPH 86. p. 143-150. paper A. R. Dick, P.H.S. Torr, and R. Cipolla. A Bayesian Estimation of Building Shape using MCMC. In The Seventh European Conference on Computer Vision, pages 852-866, 2002. paper, website SIGGRAPH course notes on Monte Carlo ray-tracing notes
Nov 12	Paper discussion and presentations	K. Sims. Evolving Virtual Creatures. SIGGRAPH 1994. webpage video, related work, more video [Alex K.] R. Grzeszczuk, D. Terzopoulos. Automated Learning of Muscle-Actuated Locomotion Through Control Abstraction. SIGGRAPH 95. paper [Eron S.] G. Lawrence, N. Cowan, S. Russell, Efficient Gradient Estimation for Motor Control Learning. In Proc. UAI-03, Acapulco, Mexico, 2003. paper, videos You can skip section 3. [Kevin F.] T. Sejnowski. Neurobiology: Making smooth moves. Nature. paper [Kevin F.] Related reading A. Ng and S. Russell. Algorithms for Inverse Reinforcement Learning. ICML 2000. paper. C. Harris and D. Wolpert. Signal-dependent noise determines motor planning. Nature, 394:780-784, 1998. paper todorov papers R. J. Williams. Simple statistical gradient-following algorithms for connectionist reinforcement learning. Machine Learning, 8:229, 1992 website J. Baxter and P. L. Bartlett. Infinite-Horizon Policy-Gradient Estimation. JAIR. 2001. citeseer page
Nov 17	Dimensionality reduction	Recommended reading (these topics will be covered in lecture as time permits) Revisit Bishop readings on PCA, if necessary S. Roweis. EM for PCA and SPCA. NIPS 97. paper CCA reading, e.g. beginning of this paper S. Mika, B. Schölkopf, A. Smola, K.-R. Müller, M. Scholz, and G. Rätsch. Kernel PCA and de-noising in feature spaces. NIPS 99. paper Bell A.J. and Sejnowski T.J. 1995. An information maximisation approach to blind separation and blind deconvolution, Neural Computation, 7, 6, 1129-1159 paper S. Roweis, L. Saul, G. Hinton. Global Coordination of Local Linear Models. NIPS '01. paper Related Reading B. Schölkopf, A. Smola, and K.-R. Müller. Nonlinear component analysis as a kernel eigenvalue problem. Neural Computation, 10:1299-1319, 1998. paper G. E. Hinton et al. An energy-based view of ICA. ICA-2001. paper M. Dontcheva, G. Yngve, Z. Popovic. Layered Acting for Character Animation. SIGGRAPH 2003. paper, webpage
Nov 19	Paper presentations and discussion	J.J. Verbeek, S. T. Roweis and N. Vlassis. Non-linear CCA and PCA by Alignment of Local Models. NIPS 2003. paper [Steven R.] C. Chennubhotla, A. Jepson. Sparse PCA: Extracting Multi-scale Structure from Data. ICCV 2001. paper [Hanieh B.] J. B. Tenenbaum, W. T. Freeman. Separating style and content with bilinear models. Neural Computation 12 (6), 1247-1283. website paper [Roland M.] Related reading (non-linear dimension reduction) G. Hinton, S. Roweis. Stochastic Neighbor Embedding. NIPS 2002. paper M. Brand. Charting a Manifold. NIPS 2002. paper Y.-W. Teh and S. Roweis. Automatic Alignment of Hidden Representations. NIPS 2002. paper Related reading (style-content separation) D. Grimes et al. Probabilistic bilinear models for appearance-based vision. ICCV 2003. A. Vasilescu and D. Terzopoulos. Multilinear Subspace Analysis for Image Ensembles. CVPR 2003. webpage
Nov 24	Paper presentations and discussion	W. Matusik, H. Pfister, M. Brand, L. McMillan. A Data-Driven Reflectance Model. SIGGRAPH 2003. paper [Greg P.] A. Efros, T. Leung. Texture synthesis by Non-Parametric Sampling. ICCV 99. webpage, paper [Marge C.] N. Jojic, B. Frey, A. Kannan. Epitomic Analysis of Appearance and Shape. ICCV 2003. website [Vladimir J.] Related reading Matusik, W., H. Pfister, M. Brand, and L McMillan, "Efficient Isotropic BRDF Measurement." In Proceedings of Eurographics Symposium on Rendering 2003. paper R. Pless. Image Spaces and Video Trajectories: Using Isomap to Explore Video Imagery. ICCV 2003. paper
Nov 26	Paper presentations and discussions	Y. Cao, P. Faloutsos, and F. Pighin. Unsupervised Learning for Speech Motion Editing. SCA 2003 paper, videos [Marge C.] Tsumura et al. Image-based skin color and texture analysis/synthesis by extracting hemoglobin and melanin information in the skin. SIGGRAPH 2003. website, video [Kevin F.] A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, S. Seitz. Image Analogies. SIGGRAPH 2001. webpage [Mike P.] Related Reading: Many more related links W. T. Freeman, E. C. Pasztor , and O. T. Carmichael. Learning low-level vision. Intl. Journal of Computer Vision, 40(1), pp. 25-47, 2000). website R. Rosales, K. Achan, B. Frey Unsupervised image translation. ICCV 2003. paper M. Cardle, S. Brooks, Z. Bar-Joseph and P. Robinson. Sound-by-Numbers: Motion-Driven Sound Synthesis. ACM SIGGRAPH Symposium on Computer Animation, San Diego, July 2003. webpage
Dec 1	Paper presentations and discussions	J. Zhang, K. Zhou, L. Velho, B. Guo, H.-Y. Shum. Synthesis of Progressively Variant Textures on Arbitrary Surfaces. SIGGRAPH 2003. paper [Alex K.] H. Chen, Y. Xu, H. Shum, S. Zhu, N. Zheng. Example-based Facial Sketch Generation with Non-Parametric Sampling. ICCV 2001. paper [Winnie T.] A. Criminisi, P. Perez, K. Toyama. Object Removal by Exemplar-based Inpainting. CVPR 2003. paper [Azeem L.] Related Reading I. Drori, D. Cohen-Or, H. Yeshurun. Fragment-based Object Removal. SIGGRAPH 2003. paper
Dec 3	Wrap-up
Dec 5 times: 12-1:30pm location: BA5181	Final presentations	Winnie Greg
Dec 15 times: 3-4:30 location: BA5181	Final presentations	Kevin Steven Roland
Dec 16 times: 1:30-3 location: BA5181	Final presentations	Eron Alex and Marge Hanieh
Dec 17 times: 1:30-3 location: BA5181	Final presentations	Vladimir Azeem Mike