|Ph.D., Computer Science, May
New York University, New York, NY
Thesis: Algorithms for Rendering in Artistic Styles
Thesis advisors: Ken Perlin and Denis Zorin
Senior Research Scientist, Adobe Systems. San Francisco, CA. October 2012-present.
Professor, University of Toronto Computer Science Department, Toronto, ON. (Assistant: Jan 2003-June 2007; Associate: July 2007-June 2012; Full: July 2012-October 2013)
Visiting Research Scientist, Pixar Animation Studios, Emeryville, CA. June 2009-February 2010.
Acting Assistant Professor, University of Washington Computer Science and Engineering Department, Seattle, WA. Fall 2001 to December 2002.
Research Intern, Microsoft Research, Redmond, WA. Summer, 2000.
Research Assistant, Stanford Computer Science Department, Stanford, CA. Spring, 2000.
Summer Intern, Mitsubishi Electric Research Laboratory, Cambridge, MA. Summer, 1999
Summer Intern, Interval Research Corporation, Palo Alto, CA. Summer, 1998
Summer Intern, NEC Research Institute, Princeton, NJ. Summer, 1997
Software Engineer, Stellartech Research Corporation, Mountain View, CA. Summer and Winter Breaks, 1992-1996
Researcher, Rice University
Computer Science Department, Houston, TX. Summer, 1996
Awards and Honors
Rice Outstanding Young Engineering Alumnus, 2011
Conference and workshop co-chair:
Conference program committees:
Refereed journal papers
Mazen Al Borno, Martin de Lasa, Aaron Hertzmann. Trajectory Optimization for Full-Body Movements with Complex Contacts, to appear in IEEE Transactions on Visualization and Computer Graphics (TVCG).
Alex Colburn, Aseem Agarwala, Aaron Hertzmann, Brian Curless, Michael F. Cohen. Image-Based Remodeling. IEEE Trans. Visualization and Computer Graphics. Jan. 2013 (vol. 19 no. 1). pp. 56-66.
Evangelos Kalogerakis, Derek Nowrouzezahrai, Simon Breslav, Aaron Hertzmann. Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Trans. Graphics. Vol. 31, No. 1. 2012
Peter O'Donovan, Aseem Agarwala, Aaron Hertzmann. Color Compatibility From Large Datasets. ACM Trans. Graphics (Proc. SIGGRAPH). 2011.
Peter O'Donovan, Aaron Hertzmann. AniPaint: Interactive Painterly Animation from Video. IEEE Trans. Visualization and Computer Graphics. March 2012. Vol. 18, No. 3. pages 475-487.
Martin de Lasa, Igor Mordatch, Aaron Hertzmann. Feature-Based Locomotion Controllers. ACM Trans. Graphics (Proc. SIGGRAPH). July 2010.
Igor Mordatch, Martin de Lasa, Aaron Hertzmann. Robust Physics-Based Locomotion Using Low-Dimensional Planning. ACM Trans. Graphics (Proc. SIGGRAPH). July 2010.
Jack M. Wang, David J. Fleet, Aaron Hertzmann. Optimizing Walking Controllers for Uncertain Inputs and Environments. ACM Trans. Graphics (Proc. SIGGRAPH). July 2010.
Evangelos Kalogerakis, Aaron Hertzmann, Karan Singh. Learning 3D Mesh Segmentation and Labeling. ACM Trans. Graphics (Proc. SIGGRAPH). July 2010.
Dan B Goldman, Brian Curless, Aaron Hertzmann, Steven M. Seitz. Shape and Spatially-Varying BRDFs From Photometric Stereo. IEEE Trans. PAMI. June 2010.
Marcus A. Brubaker, David J. Fleet, Aaron Hertzmann. Physics-based Person Tracking Using the Anthropomorphic Walker. International Journal of Computer Vision. March 2010. Vol. 87, Nos 1-2.
Jack M. Wang, David J. Fleet, Aaron Hertzmann. Optimizing Walking Controllers. ACM Trans. on Graphics (Proc. SIGGRAPH Asia 2009). Vol. 28, No. 5. December 2009.
Evangelos Kalogerakis, Derek Nowrouzezahrai, Patricio Simari, James McCrae, Aaron Hertzmann, Karan Singh. Data-driven curvature for real-time line drawing of dynamic scenes. ACM Trans. on Grahics. January 2009. Vol. 28, No. 1.
Lorenzo Torresani, Aaron Hertzmann, Christoph Bregler. Non-Rigid Structure-From-Motion: Estimating Shape and Motion with Hierarchical Priors. IEEE Trans. PAMI. May 2008. Vol. 30, No. 5. pp. 878-892.
Jack M. Wang, David J. Fleet, Aaron Hertzmann. Gaussian Process Dynamical Models for Human Motion. IEEE Trans. PAMI. February 2008. Vol. 30, No. 2. pp. 283-298.
Seth Cooper, Aaron Hertzmann, Zoran Popović. Active Learning for Real-Time Motion Controllers. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2007.
Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis, William T. Freeman. Removing Camera Shake From A Single Photograph. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2006. 25(3):787-794.
C. Karen Liu, Aaron Hertzmann, Zoran Popović. Learning Physics-Based Motion Style with Nonlinear Inverse Optimization ACM Trans. on Graphics (Proc. SIGGRAPH). 2005. pp. 1071-1081.
Aaron Hertzmann, Steven M. Seitz. Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs. IEEE Trans. PAMI, August 2005. Vol. 27, No. 8, pp. 1254-1264.
Aseem Agarwala, Aaron Hertzmann, David H. Salesin, Steven M. Seitz. Keyframe-Based Tracking for Rotoscoping and Animation. ACM Trans. on Graphics (Proc. SIGGRAPH). 2004. pp. 584-591.
Keith Grochow, Steven L. Martin, Aaron Hertzmann, Zoran Popović. Style-Based Inverse Kinematics. ACM Trans. on Graphics (Proc. SIGGRAPH). 2004. pp. 522-531.
Reviewed conference papers
Aaron Hertzmann. Non-Photorealistic Rendering and the Science of Art. NPAR 2010.
Martin de Lasa, Aaron Hertzmann. Prioritized Optimization for Task-Space Control. IROS 2009.
Evangelos Kalogerakis, Olga Vesselova, James Hays, Alexei A. Efros, Aaron Hertzmann. Image Sequence Geolocation with Human Travel Priors. ICCV 2009.
Ian Vollick, Daniel Vogel, Maneesh Agrawala, Aaron Hertzmann. Specifying Label Layout Styles by Example. UIST 2007. pp. 221-230.
Todd Goodwin, Ian Vollick, Aaron Hertzmann. Isophote Distance: A Shading Approach to Artistic Stroke Thickness. NPAR 2007. August 2007. pp. 53-62.
Marcus Brubaker, David J. Fleet, Aaron Hertzmann. Physics-Based Person Tracking Using Simplified Lower-Body Dynamics. CVPR 2007. June 2007. pp. 1-8.
Jack M. Wang, David J. Fleet, Aaron Hertzmann. Multifactor Gaussian Process Models for Style-Content Separation. ICML 2007. June 2007. pp. 975-982
C. Karen Liu, Aaron Hertzmann, Zoran Popović. Composition of Complex Optimal Multi-Character Motions. SCA 2006. pp. 215-222.
Brett Allen, Brian Curless, Zoran Popović, Aaron Hertzmann. Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis. SCA 2006. pp. 147-156.
Alexander Kolliopoulos, Jack M. Wang, Aaron Hertzmann. Segmentation-Based 3D Artistic Rendering. EGSR 2006. Nicosia, Cyprus. June 28, 2006. pp. 361-370.
Jack M. Wang, David J. Fleet, Aaron Hertzmann. Gaussian Process Dynamical Models. NIPS 18, 2006. pp. 1441-1448.
Aaron P. Shon, Keith Grochow, Aaron Hetzmann, Rajesh P. N. Rao. Learning Shared Latent Structure for Image Synthesis and Robotic Imitation, NIPS 18, 2006. pp. 1233-1240.
Raquel Urtasun, David J. Fleet, Aaron Hertzmann, Pascal Fua. Priors for People Tracking from Small Training Sets. ICCV 2005. Beijing, China. October 18. pp. 403-410.
Daniel B. Goldman, Brian Curless, Aaron Hertzmann, Steven M. Seitz. Shape and Spatially-Varying BRDFs from Photometric Stereo. ICCV 2005. Beijing, China. October 18. pp 341-348.
Kannan Achan, Sam Roweis, Aaron Hertzmann, Brendan Frey. A Segment-Based Probabilistic Generative Model of Speech. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2005). Philadelphia, PA. Vol.5, pages 221-224.
Lorenzo Torresani, Aaron Hertzmann. Automatic Non-Rigid 3D Modeling from Video. Proc. ECCV 2004. pp. 299-312. May, 2004. Prague, Czech Republic.
Adrien Treuille, Aaron Hertzmann, Steven M. Seitz. Example-Based Stereo with General BRDFs. Proc. ECCV 2004. pp. 457-469. May, 2004. Prague, Czech Republic.
Lorenzo Torresani, Aaron Hertzmann, Christoph Bregler. Learning Non-Rigid 3D Shape from 2D Motion. Proc. NIPS 2003. Vancouver, BC. pp. 1555-1562
Li Zhang, Brian Curless, Aaron Hertzmann, Steven M. Seitz. Shape and Motion under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-view Stereo. Proc. ICCV 2003. Nice, France. October 2003. pp. 618-625.
Aaron Hertzmann, Steven M. Seitz. Shape and Materials by Example: A Photometric Stereo Approach. Proc. IEEE CVPR 2003. Madison, WI. June 2003. Vol. 1. pp. 533-540.
Aaron Hertzmann, Nuria Oliver, Brian Curless, Steven M. Seitz. Curve Analogies. Proc. 13th Eurographics Workshop on Rendering, Pisa, Italy. June 26-28, 2002. pp. 233-245.
Aaron Hertzmann. Fast Paint Texture. NPAR 2002: Second International Symposium on Non-Photorealistic Animation and Rendering. Annecy, France. June 3-5, 2002. pp. 91-96, 161.
Aaron Hertzmann, Charles E. Jacobs, Nuria Oliver, Brian Curless, David H. Salesin. Image Analogies. SIGGRAPH 2001 Conference Proceedings. August 12-17, 2001. pp. 327-340.
Lexing Ying, Aaron Hertzmann, Henning Biermann, Denis Zorin. Texture and Shape Synthesis on Surfaces. Proc. 12th Eurographics Workshop on Rendering. June 25-27, 2001. pp. 301-312.
Aaron Hertzmann. Paint By Relaxation. Proc. Computer Graphics International 2001. July 3-6, 2001. pp. 47-54.
Aaron Hertzmann, Denis Zorin. Illustrating smooth surfaces. SIGGRAPH 2000 Conference Proceedings. New Orleans, Louisiana. July 2000. pp. 517-526.
Matthew Brand, Aaron Hertzmann. Style machines. SIGGRAPH 2000 Conference Proceedings. New Orleans, Louisiana. July 2000. pp. 183-192.
Christoph Bregler, Aaron Hertzmann, Henning Biermann. Recovering Non-Rigid 3D Shape from Image Streams Proc. IEEE CVPR 2000. June 13-15, 2000. pp. 690-696.
Aaron Hertzmann, Ken Perlin. Painterly Rendering for Video and Interaction. Proc. First International Symposium on Non-Photorealistic Animation and Rendering. June 5-7, 2000. pp. 7-12, 121.
Aaron Hertzmann. Painterly Rendering with Curved Brush Strokes of Multiple Sizes. SIGGRAPH 98 Conference Proceedings. July, 1998. pp. 453-460.
Reviewed workshop papers
Michael Guerzhoy, Aaron Hertzmann. Learning Latent Factor Models of Human Travel. NIPS 2012 Workshop on Social Network and Social Media Analysis.
Azeem Lakdawalla, Aaron Hertzmann. Shape from Video: Dense Shape, Texture, Motion and Lighting from Monocular Image Streams.. Workshop on Photometric Analysis for Computer Vision 2007. Rio de Janeiro, Brazil. 2007.
Marcus Brubaker, David J. Fleet, Aaron Hertzmann. Physics-Based Human Pose Tracking. EHuM: Evaluation of Articulated Human Motion and Pose Estimation. Whistler, BC. December, 2006.
Andrew Wright, Suresh Jagannathan, Cristian Ungureanu, Aaron Hertzmann. Compiling Java to a Typed Lambda-Calculus: A Preliminary Report. Proc. Second Intl. Workshop on Types in Compilation. Springer-Verlag LNCS 1473. March 1998. pp. 9-27.
A. Hertzmann, V. Zordan. Introduction to CG&A Special Issue on Physics-Based Characters. IEEE Computer Graphics & Applications. vol. 31, no. 1, July/August 2011
Aaron Hertzmann. Introduction to Bayesian Learning. SIGGRAPH 2004 Course notes. 78 pages.
Aaron Hertzmann. Machine Learning for Computer Graphics: A Manifesto and Tutorial. Proc. Pacific Graphics 2003. Invited Paper. Banff, Alberta. October, 2003. pp. 22-36.
Aaron Hertzmann. A Survey of Stroke-Based Rendering. IEEE Computer Graphics & Applications, Special Issue on Non-Photorealistic Rendering. July/August, 2003 (Vol. 23, No. 4) pp. 70-81.
Chee Yap, Henning Biermann, Aaron Hertzmann, Chen Li, Jon Meyer, Hsing-Kuo Pao, Salvatore Paxia. A Different Manhattan Project: Automatic Statistical Model Generation. Proc. SPIE Visualization and Data Analysis 2002.
Aaron Hertzmann. Introduction to 3D Non-Photorealistic Rendering: Silhouettes and Outlines. SIGGRAPH 99 Course Notes (Course on Non-Photorealistic Rendering). August 9, 1999.
A. Hertzmann. Data Synthesis with Expectation-Maximization. University of Toronto Tech Report DGP-TR-2004-001. June 30, 2004.
Aaron Hertzmann. Paint by Relaxation. NYU CS Technical Report 2000-801. May, 2000
Aaron Hertzmann. Interactive 3D Scene Reconstruction from Images. NYU CS Technical Report 1999-783. April 22, 1999.
Henning Biermann, Aaron Hertzmann, Jon Meyer, Ken Perlin. Stateless Remote Environment Navigation with View Compression. NYU CS Technical Report 1999-784. April 22, 1999.
Aaron Hertzmann, Trevor
Darrell. Hybrid rigid and
non-rigid image-based modeling of articulated figures. Interval
Research Corporation Technical Report 1998-045.
William T. Freeman, Robert Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis. Removing camera shake from a single photograph using statistics of a natural image. US Patent No. 7,616,826. Nov 10, 2009.
Aaron Hertzmann, Henning Biermann, Jon Meyer, Kenneth Perlin. Stateless remote environment navigation. US Patent No. 6,628,282. Sep 30, 2003.
Aaron Hertzmann, Ken Perlin. Method and system for generating an image having a hand-painted appearance. US Patent No. 6,011,536. Jan. 2000.
Painterly animation for "The Spine" (2009), directed by Chris Landreth, produced by National Film Board of Canada and Copperheart Entertainment. Credit: "NPR Consultant"
Painterly animation for
"Nickellennium," broadcast worldwide on Nickelodeon, Jan 1,
IllustrationIllustrations for Modeling Trust Context in Networks, by Sibel Adali. Springer, 2013.
"Paint on Canvas."
Digital Arts & Culture 2001 art gallery. Providence, RI. April 26-28, 2001.
"END-USER LICENSE AGREEMENT (EULA)." Digital Arts & Culture 2001 art gallery. Providence, RI. April 26-28, 2001.
Hallucinations," work led by Trevor Darrell. Exhibitions: SIGGRAPH
98 Emerging Technologies; The Tech Museum of Innovation, San Jose,
CA, Oct 1998-Mar 1999.
Feature-Based Locomotion Control
Removing Camera Shake from a Single Photograph
Learning Biomechanical Models of Human Motion
Art, Vision, Probability
Machine Learning for Computer Graphics
Algorithms for Rendering in Artistic Styles
SIGGRAPH Course Presentations
Biomechanical Principles of Human Locomotion
Introduction to Bayesian Learning (Course Organizer)
Silhouettes and Outlines; Painterly Rendering
Feature-Based Locomotion Controllers
Non-Photorealistic Rendering and the Science of Art
Non-Photorealisic Rendering: Painterly Rendering and Line Drawing
Image Sequence Geolocation with Human Travel Priors
Learning Human Motion Models for Tracking and Animation
Isophote Distance: A Shading Approach to Artistic Stroke Thickness
Example-Based Analysis and Synthesis of Shape, Reflectance, and Style
Automatic Non-Rigid Modeling from Video
Removing Camera Shake from a Single Photograph
Machine Learning for Computer Graphics
Introduction to Bayesian Learning
Shape and Materials by Example: A Photometric Stereo Approach
Fast Paint Texture
Algorithms for Rendering in Artistic Styles
Paint by Relaxation
Illustrating smooth surfaces
Painterly Rendering for Video and Interaction.
Styles for Painting, Illustration, and Character Animation.
Tutorial on Painterly Rendering
Painterly Rendering with Curved Brush Strokes of Multiple Sizes
GRACE - Graphical Ruler and Compass Editor.
"Walk like a human." New Scientist. 7 August 2010. p. 18-19.
"Prototype: Auto Animator." Technology Review. November 2004.
"U of T pixel-Picasso makes MIT top 100." The Varsity (student newspaper). September 23, 2004. page 1.
"Canadian researchers at top of class". The Globe and Mail. September 20, 2004. page A1.
"Rendu Non-Photoréaliste: Au Point". Pixel. Juin-Juillet 2004, 91H. pages 42-43.
"Paint by Pixel". Science News Online. Feb 14, 2004.
"Thanks to 'Professor Picasso' techniques of master artists just a click away," by Rob Harril. University of Washington University Week. February 14, 2002. page 5.
"So you're no oil painting. This software could change all that", by Charles Arthur. The Independent. August 29, 2001.
"Stroke of genius as computer learns to paint a new picture," by Eddie Cassidy. Irish Examiner. August 29, 2001.
"Fine art is easy," by David Smith. Daily Express. August 28, 2001.
"Vincent gets snappy," by Catherine Zandonella. New Scientist. August 25, 2001. page 21.
"Computer mimics great masters' style". BBC News. August 23, 2001.
"Brown Outing", by Reema Jana. Artforum. April 2001. page 43.
"The Tech Beat," by Adam Balkin. NY1 News. Broadcast on Feburary 1, 2000.
"Morning Satellite," TV-Tokyo. Broadcast on Sep 17, 1999.