Aaron Hertzmann

Education

M.S. Computer Science, January 1998
New York University, New York, NY

B.A. Computer Science and Art & Art History, May 1996
Rice University, Houston, TX

Current Positions

Associate Professor, University of Toronto Computer Science Department, Toronto, ON. July 2007-present.

Affiliate Faculty, University of Washington Computer Science and Engineering Department, Seattle, WA. September 2005-present.

Experience

Assistant Professor, University of Toronto Computer Science Department, Toronto, ON. January 2003-June 2007.

Acting Assistant Professor, University of Washington Computer Science and Engineering Department, Seattle, WA. Fall 2001 to December 2002.

Research Intern, Microsoft Research, Redmond, WA. Summer, 2000.

Research Assistant, Stanford Computer Science Department, Stanford, CA. Spring, 2000.

Summer Intern, Mitsubishi Electric Research Laboratory, Cambridge, MA. Summer, 1999

Summer Intern, Interval Research Corporation, Palo Alto, CA. Summer, 1998

Summer Intern, NEC Research Institute, Princeton, NJ. Summer, 1997

Software Engineer, Stellartech Research Corporation, Mountain View, CA. Summer and Winter Breaks, 1992-1996

Student Researcher, Rice University Computer Science Department, Houston, TX. Summer, 1996

Awards and Honors

Professional Activities

Editorial boards:
Associate Editor, IEEE Transactions on Visualization and Computer Graphics (2006 to present)
Associate Editor, Foundations and Trends in Computer Graphics and Vision (2004 to present)

Program member:
Canadian Institute for Advanced Research, Neural Computation and Adaptive Perception program (Associate: 2006-2007; Scholar: 2007-present)

Conference and workshop chair:
Symposium on Non-Photorealistic Animation and Rendering (NPAR 2004), Annecy, France (co-chair)
NIPS 2004 Workshop on Learning in Graphics and Vision (co-organizer)

Conference program committees:
ACM SIGGRAPH 2003, 2004, 2006, 2007 (Area Coordinator)
Eurographics Symposium on Rendering 2003, 2006, 2007
International Symposium on Non-Photorealistic Animation and Rendering (NPAR) 2002, 2006, 2007, 2008
ACM/Eurographics Symposium on Computer Animation (SCA) 2005, 2006, 2007
Pacific Graphics 2002, 2004
Graphics Interface 2004

Juries:
Annecy International Animated Film Festival 2004, Internet films division

Paper reviewing:
SIGGRAPH 1999-2002; I3DG 2001-2003; IEEE PAMI; GI 2001; EGWR 2001-2002; ACM TOG; ACM TAP; CGF; EG 2002; NIPS 2003-2004; UIST 2003; IEEE CG&A; IEEE TVCG; SGP 2003

Scientific Publications

Refereed journal papers

Lorenzo Torresani, Aaron Hertzmann, Christoph Bregler. Non-Rigid Structure-From-Motion: Estimating Shape and Motion with Hierarchical Priors. IEEE Trans. PAMI. May 2008. Vol. 30, No. 5. pp. 878-892.

Jack M. Wang, David J. Fleet, Aaron Hertzmann. Gaussian Process Dynamical Models for Human Motion. IEEE Trans. PAMI. February 2008. Vol. 30, No. 2. pp. 283-298.

Seth Cooper, Aaron Hertzmann, Zoran Popović. Active Learning for Real-Time Motion Controllers. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2007.

Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis, William T. Freeman. Removing Camera Shake From A Single Photograph. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2006. 25(3):787-794.

C. Karen Liu, Aaron Hertzmann, Zoran Popović. Learning Physics-Based Motion Style with Nonlinear Inverse Optimization ACM Trans. on Graphics (Proc. SIGGRAPH). pp. 1071-1081.

Aaron Hertzmann, Steven M. Seitz. Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs. IEEE Trans. PAMI, August 2005. Vol. 27, No. 8, pp. 1254-1264.

Aseem Agarwala, Aaron Hertzmann, David H. Salesin, Steven M. Seitz. Keyframe-Based Tracking for Rotoscoping and Animation. ACM Trans. on Graphics (Proc. SIGGRAPH). pp. 584-591.

Keith Grochow, Steven L. Martin, Aaron Hertzmann, Zoran Popović. Style-Based Inverse Kinematics. ACM Trans. on Graphics (Proc. SIGGRAPH). pp. 522-531.

Reviewed conference papers

Ian Vollick, Daniel Vogel, Maneesh Agrawala, Aaron Hertzmann. Specifying Label Layout Styles by Example. UIST 2007. pp. 221-230.

Todd Goodwin, Ian Vollick, Aaron Hertzmann. Isophote Distance: A Shading Approach to Artistic Stroke Thickness. NPAR 2007. August 2007. pp. 53-62.

Marcus Brubaker, David J. Fleet, Aaron Hertzmann. Physics-Based Person Tracking Using Simplified Lower-Body Dynamics. CVPR 2007. June 2007. pp. 1-8.

Jack M. Wang, David J. Fleet, Aaron Hertzmann. Multifactor Gaussian Process Models for Style-Content Separation. ICML 2007. June 2007. pp. 975-982

C. Karen Liu, Aaron Hertzmann, Zoran Popović. Composition of Complex Optimal Multi-Character Motions. SCA 2006. pp. 215-222.

Brett Allen, Brian Curless, Zoran Popović, Aaron Hertzmann. Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis. SCA 2006. pp. 147-156.

Alexander Kolliopoulos, Jack M. Wang, Aaron Hertzmann. Segmentation-Based 3D Artistic Rendering. EGSR 2006. Nicosia, Cyprus. June 28, 2006. pp. 361-370.

Jack M. Wang, David J. Fleet, Aaron Hertzmann. Gaussian Process Dynamical Models. NIPS 18, 2006. pp. 1441-1448.

Aaron P. Shon, Keith Grochow, Aaron Hetzmann, Rajesh P. N. Rao. Learning Shared Latent Structure for Image Synthesis and Robotic Imitation, NIPS 18, 2006. pp. 1233-1240.

Raquel Urtasun, David J. Fleet, Aaron Hertzmann, Pascal Fua. Priors for People Tracking from Small Training Sets. ICCV 2005. Beijing, China. October 18. pp. 403-410.

Daniel B. Goldman, Brian Curless, Aaron Hertzmann, Steven M. Seitz. Shape and Spatially-Varying BRDFs from Photometric Stereo. ICCV 2005. Beijing, China. October 18. pp 341-348.

Kannan Achan, Sam Roweis, Aaron Hertzmann, Brendan Frey. A Segment-Based Probabilistic Generative Model of Speech. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2005). Philadelphia, PA. Vol.5, pages 221-224.

Lorenzo Torresani, Aaron Hertzmann. Automatic Non-Rigid 3D Modeling from Video. Proc. ECCV 2004. pp. 299-312. May, 2004. Prague, Czech Republic.

Adrien Treuille, Aaron Hertzmann, Steven M. Seitz. Example-Based Stereo with General BRDFs. Proc. ECCV 2004. pp. 457-469. May, 2004. Prague, Czech Republic.

Lorenzo Torresani, Aaron Hertzmann, Christoph Bregler. Learning Non-Rigid 3D Shape from 2D Motion. Proc. NIPS 2003. Vancouver, BC. pp. 1555-1562

Li Zhang, Brian Curless, Aaron Hertzmann, Steven M. Seitz. Shape and Motion under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-view Stereo. Proc. ICCV 2003. Nice, France. October 2003. pp. 618-625.

Aaron Hertzmann, Steven M. Seitz. Shape and Materials by Example: A Photometric Stereo Approach. Proc. IEEE CVPR 2003. Madison, WI. June 2003. Vol. 1. pp. 533-540.

Aaron Hertzmann, Nuria Oliver, Brian Curless, Steven M. Seitz. Curve Analogies. Proc. 13th Eurographics Workshop on Rendering, Pisa, Italy. June 26-28, 2002. pp. 233-245.

Aaron Hertzmann. Fast Paint Texture. NPAR 2002: Second International Symposium on Non-Photorealistic Animation and Rendering. Annecy, France. June 3-5, 2002. pp. 91-96, 161.

Aaron Hertzmann, Charles E. Jacobs, Nuria Oliver, Brian Curless, David H. Salesin. Image Analogies. SIGGRAPH 2001 Conference Proceedings. August 12-17, 2001. pp. 327-340.

Lexing Ying, Aaron Hertzmann, Henning Biermann, Denis Zorin. Texture and Shape Synthesis on Surfaces. Proc. 12th Eurographics Workshop on Rendering. June 25-27, 2001. pp. 301-312.

Aaron Hertzmann. Paint By Relaxation. Proc. Computer Graphics International 2001. July 3-6, 2001. pp. 47-54.

Aaron Hertzmann, Denis Zorin. Illustrating smooth surfaces. SIGGRAPH 2000 Conference Proceedings. New Orleans, Louisiana. July 2000. pp. 517-526.

Matthew Brand, Aaron Hertzmann. Style machines. SIGGRAPH 2000 Conference Proceedings. New Orleans, Louisiana. July 2000. pp. 183-192.

Christoph Bregler, Aaron Hertzmann, Henning Biermann. Recovering Non-Rigid 3D Shape from Image Streams Proc. IEEE CVPR 2000. June 13-15, 2000. pp. 690-696.

Aaron Hertzmann, Ken Perlin. Painterly Rendering for Video and Interaction. Proc. First International Symposium on Non-Photorealistic Animation and Rendering. June 5-7, 2000. pp. 7-12, 121.

Aaron Hertzmann. Painterly Rendering with Curved Brush Strokes of Multiple Sizes. SIGGRAPH 98 Conference Proceedings. July, 1998. pp. 453-460.

Reviewed workshop papers

Azeem Lakdawalla, Aaron Hertzmann. Shape from Video: Dense Shape, Texture, Motion and Lighting from Monocular Image Streams.. Workshop on Photometric Analysis for Computer Vision 2007. Rio de Janeiro, Brazil. 2007.

Marcus Brubaker, David J. Fleet, Aaron Hertzmann. Physics-Based Human Pose Tracking. EHuM: Evaluation of Articulated Human Motion and Pose Estimation. Whistler, BC. December, 2006.

Andrew Wright, Suresh Jagannathan, Cristian Ungureanu, Aaron Hertzmann. Compiling Java to a Typed Lambda-Calculus: A Preliminary Report. Proc. Second Intl. Workshop on Types in Compilation. Springer-Verlag LNCS 1473. March 1998. pp. 9-27.

Other publications

Aaron Hertzmann. Introduction to Bayesian Learning. SIGGRAPH 2004 Course notes. 78 pages.

Aaron Hertzmann. Machine Learning for Computer Graphics: A Manifesto and Tutorial. Proc. Pacific Graphics 2003. Invited Paper. Banff, Alberta. October, 2003. pp. 22-36.

Aaron Hertzmann. A Survey of Stroke-Based Rendering. IEEE Computer Graphics & Applications, Special Issue on Non-Photorealistic Rendering. July/August, 2003 (Vol. 23, No. 4) pp. 70-81.

Chee Yap, Henning Biermann, Aaron Hertzmann, Chen Li, Jon Meyer, Hsing-Kuo Pao, Salvatore Paxia. A Different Manhattan Project: Automatic Statistical Model Generation. Proc. SPIE Visualization and Data Analysis 2002.

Aaron Hertzmann. Introduction to 3D Non-Photorealistic Rendering: Silhouettes and Outlines. SIGGRAPH 99 Course Notes (Course on Non-Photorealistic Rendering). August 9, 1999.

Technical reports

A. Hertzmann. Data Synthesis with Expectation-Maximization. University of Toronto Tech Report DGP-TR-2004-001. June 30, 2004.

Aaron Hertzmann. Paint by Relaxation. NYU CS Technical Report 2000-801. May, 2000

Aaron Hertzmann. Interactive 3D Scene Reconstruction from Images. NYU CS Technical Report 1999-783. April 22, 1999.

Henning Biermann, Aaron Hertzmann, Jon Meyer, Ken Perlin. Stateless Remote Environment Navigation with View Compression. NYU CS Technical Report 1999-784. April 22, 1999.

Aaron Hertzmann, Trevor Darrell. Hybrid rigid and non-rigid image-based modeling of articulated figures. Interval Research Corporation Technical Report 1998-045.

Patents

Aaron Hertzmann, Henning Biermann, Jon Meyer, Kenneth Perlin. Stateless remote environment navigation. US Patent No. 6,628,282. Sep 30, 2003.

Aaron Hertzmann, Ken Perlin. Method and system for generating an image having a hand-painted appearance. US Patent No. 6,011,536. Jan. 2000.

Art

Animation

Painterly animation for "Nickellennium," broadcast worldwide on Nickelodeon, Jan 1, 2000.

Installations

"Paint on Canvas." Digital Arts & Culture 2001 art gallery. Providence, RI. April 26-28, 2001.
Analogic Sensations: Festival for Expanded Media. New York, July 13, 2002.

"END-USER LICENSE AGREEMENT (EULA)." Digital Arts & Culture 2001 art gallery. Providence, RI. April 26-28, 2001.

Contributed to "Mass Hallucinations," work led by Trevor Darrell. Exhibitions: SIGGRAPH 98 Emerging Technologies; The Tech Museum of Innovation, San Jose, CA, Oct 1998-Mar 1999.

Teaching

Click here for courses I've taught or organized

Students

Click here for student advising

Presentations

Invited Talks

Removing Camera Shake from a Single Photograph
Workshop on Vision, Video, and Graphics. Invited Talk. Warwick, England. September 14, 2007.

Learning Biomechanical Models of Human Motion
Workshop on Convergence of Graphics and Vision. Keynote Talk. Informatikzentrum Schloss Dagstuhl. Wadern, Germany. April 26, 2007.
Current Trends in Computer Vision 2006. Lhasa, Tibet. August 9, 2006.
CIAR Workshop on Extracting Human Motion from Video, Toronto, ON, July 10, 2005.

Learning Pose and Motion Models for Computer Animation
Gaussian Processes in Practice Workshop. Invited Talk. Bletchley Park, UK. June 13, 2006 [video].

Art, Vision, Probability
Symposium on Computational Photography and Video, Invited Talk. Cambridge, MA. May 24, 2005.

Machine Learning for Computer Graphics
Pacific Graphics 2003. Invited Talk. Banff, AB. October 9, 2003.
CMU Robotics Institute VASC Retreat. Invited Talk. Hidden Valley Resort, PA. January 29, 2002.

Algorithms for Rendering in Artistic Styles
CAD/CG conference. Invited Talk. Kunming, China. August 24, 2001.

Other presentations

Isophote Distance: A Shading Approach to Artistic Stroke Thickness
NPAR, San Diego, CA. August 4, 2007
Adobe Research, Seattle, WA. July 20, 2007

Example-Based Analysis and Synthesis of Shape, Reflectance, and Style
Kodak Research Laboratory, Rochester, NY, May 22, 2007.
Rice University Computer Science Department, Houston, TX, March 11, 2005.
CORE Feature Animation, Toronto, ON, March 1, 2005.
MIT CSAIL, Cambridge, MA. September 27, 2004.
Tsinghua University, Beijing, China. August 24, 2004.
Microsoft Research Asia, Beijing, China. August 23, 2004.
INRIA Rhône-Alpes, Grenoble, France. June 1, 2004.
ETH, Zürich, Switzerland. May 28, 2004.

Removing Camera Shake from a Single Photograph
Microsoft Research, Redmond, WA, July 18, 2007. [video]
Rice University CS Department, Houston, TX, November 20, 2006.
Microsoft Research, Cambridge, UK, June 14, 2006.
Stanford Graphics Lunch, Stanford, CA, April 20, 2006.
UC Berkeley CS Department, Berkeley, CA, April 19, 2006.

Learning Human Motion Models for Tracking and Animation
Microsoft Research, Cambridge, England, September 11, 2007.
Pixar Animation Studios, Emeryville, CA, April 18, 2006.

Machine Learning for Computer Graphics
Canadian Institute for Advanced Research NCAP Summer School 2005. Toronto, ON. July 16, 2005.
Rensselaer Joint ECSE/CS Colloquium. Troy, NY. Februrary 21, 2003.

Introduction to Bayesian Learning
SIGGRAPH 2004 Tutorial, Los Angeles, CA. August 9, 2004.
New York University, New York, NY. July, 2004.

Automatic Non-Rigid Modeling from Video
University of Washington CSE Department. Seattle, WA. July 18, 2003.
Microsoft Research. Redmond, WA. July 3, 2003.

Shape and Materials by Example: A Photometric Stereo Approach
CVPR 2003. Madison, WI. June 19, 2003.
NYU Computer Science Vision Talk. New York, NY. May 11, 2003.

Curve Analogies
SIGGRAPH 2002 Technical Sketch. San Antonio, Texas. July 24, 2002.
EGWR 2002. Pisa, Italy. June 28, 2002.

Fast Paint Texture
NPAR 2002. Annecy, France. June 4, 2002.

Image Analogies
NIPS 2001 Workshop on Machine Learning Methods for Images and Text. Whistler/Blackcomb Resort, BC. December 8, 2001.
SIGGRAPH 2001. Los Angeles, CA. August 16, 2001.
Microsoft Research. Redmond, WA. August 8, 2001.

Algorithms for Rendering in Artistic Styles
Zhejiang University. Hangzhou, China. September 11, 2001.
Microsoft Research. Beijing, China. August 29, 2001.
Microsoft Research. Redmond, WA. June 11, 2001.
University of Pennsylvania. Philadelpha, PA. April 19, 2001.
University of California at San Diego. La Jolla, CA. April 11, 2001.
Massachussetts Institute of Technology EECS Dept. Cambridge, MA. April 5, 2001.
University of Wisconsin at Madison. Madison, WI. April 2, 2001.
University of Illinois at Urbana-Champaign CS Department. Urbana, IL. March 26, 2001.
Georgia Institute of Technology College of Computing. Atlanta, GA. March 15, 2001.
University of Michigan EECS Department. Ann Arbor, MI. March 12, 2001.
Johns Hopkins University CS Department. Baltimore, MD. March 9, 2001.
Carnegie Mellon University SCS. Pittsburgh, PA. March 5, 2001.
University of Toronto CS Department. Toronto, ON. February 28, 2001.
Columbia University CS Department. New York, NY. Feburary 26, 2001.
Purdue Univeristy CSE Department. West Lafayette, IN. February 22, 2001.
Northwestern University CS Departmnent. Evanston, IL. Feburary 20, 2001.
University of British Columbia CS Department. Vancouver, BC. February 15, 2001.

Paint by Relaxation
Computer Graphics International. Hong Kong, China. July 4, 2001.

Style Machines
Harvard CS Departmental Colloquium. Cambridge, MA. November 20, 2000.
NYU CS Student Seminar. New York, NY. October 16, 2000.
Princeton Graphics and Geometry Lunch. Princeton, NJ. October 2, 2000.
SIGGRAPH 2000. New Orleans, LA.
Microsoft Research. Redmond, WA. May 23, 2000.

Illustrating smooth surfaces
Microsoft NetDocs Media group. Redmond, WA. August 10, 2000.
SIGGRAPH 2000. New Orleans, LA.

Painterly Rendering for Video and Interaction.
First International Symposium on Non-Photorealistic Rendering. June 5-7, 2000. Annecy, France.

Styles for Painting, Illustration, and Character Animation.
Graphics Cafe, Stanford Computer Science Department. Stanford, CA. March 2, 2000.
Rice University Computer Science Department, Houston, TX. Nov 29, 1999.
IMPA Visgraf, Rio de Janeiro, Brazil, March 17, 1999.

Tutorial on Painterly Rendering
Walt Disney Feature Animation. Burbank, CA. July 14, 1999.

Painterly Rendering with Curved Brush Strokes of Multiple Sizes
NYU CS Student Seminar, Fall 1998
SIGGRAPH, July 1998
Interval Research Corporation, June 1998

GRACE - Graphical Ruler and Compass Editor.
Fifth SIAM Conference on Geometric Design. Nashville, Nov. 1997

Press Coverage and Press Releases

"Recognizing the Brightest Minds in Computer Science," Microsoft Press Release. May 3, 2006.

"Microsoft Research Recognizes Computer Science's Most Promising Professors With New Faculty Fellowships," Microsoft Press Release. April 26, 2006.

"Prototype: Auto Animator." Technology Review. November 2004.

"U of T pixel-Picasso makes MIT top 100." The Varsity (student newspaper). September 23, 2004. page 1.

"Canadian researchers at top of class". The Globe and Mail. September 20, 2004. page A1.

"Rendu Non-Photoréaliste: Au Point". Pixel. Juin-Juillet 2004, 91H. pages 42-43.

"Paint by Pixel". Science News Online. Feb 14, 2004.

"Thanks to 'Professor Picasso' techniques of master artists just a click away," by Rob Harril. University of Washington University Week. February 14, 2002. page 5.

"Prototype: Virtual Virtuosity," by Nick Montfort. Technology Review. November, 2001. page 20.

"So you're no oil painting. This software could change all that", by Charles Arthur. The Independent. August 29, 2001.

"Stroke of genius as computer learns to paint a new picture," by Eddie Cassidy. Irish Examiner. August 29, 2001.

"Fine art is easy," by David Smith. Daily Express. August 28, 2001.

"Vincent gets snappy," by Catherine Zandonella. New Scientist. August 25, 2001. page 21.

"Computer mimics great masters' style". BBC News. August 23, 2001.

"Brown Outing", by Reema Jana. Artforum. April 2001. page 43.

"A Matter of Style," by Diana Mahoney. Computer Graphics World. August 2000. page 20.

"The Tech Beat," by Adam Balkin. NY1 News. Broadcast on Feburary 1, 2000.

"Morning Satellite," TV-Tokyo. Broadcast on Sep 17, 1999.

Slashdot threads: Image Analogies, Style IK