Aaron Hertzmann's research

Selected publications

Non-Rigid Structure-From-Motion Non-Rigid Structure-From-Motion: Estimating Shape and Motion with Hierarchical Priors.
L. Torresani, A. Hertzmann, C. Bregler. IEEE Transactions on Pattern Analysis and Machine Intelligence. May 2008. Vol. 30, No. 5. pp. 878-892.
(Journal version based on CVPR 00, 01, and NIPS 2003 papers)
Gaussian Process Dynamical Models Gaussian Process Dynamical Models for Human Motion
J. M. Wang, D. J. Fleet, A. Hertzmann. IEEE Transactions on Pattern Analysis and Machine Intelligence. Feb 2008. Vol. 30, No. 2. pp. 283-298.
(Journal version of NIPS 2006 paper "Gaussian Process Dynamical Models").
Shape from Video Shape from Video: Dense Shape, Texture, Motion and Lighting from Monocular Image Streams.
A. Lakdawalla, A. Hertzmann. Workshop on Photometric Analysis in Computer Vision 2007.
Learning Label Layout Specifying Label Layout Styles by Example
I. Vollick, D. Vogel, M. Agrawala, A. Hertzmann. UIST 2007. pp. 221-230.
Active Learning for Mocap Active Learning for Real-Time Motion Controllers
S. Cooper, A. Hertzmann, Z. Popović. ACM Trans. on Graphics (SIGGRAPH 2007).
Stroke Thickness Isophote Distance: A Shading Approach to Artistic Stroke Thickness
T. Goodwin, I. Vollick, A. Hertzmann. NPAR 2007. pp. 53-62.
Physics-Based Person Tracking Physics-Based Person Tracking Using Simplified Lower-Body Dynamics
M. Brubaker, D. J. Fleet, A. Hertzmann. CVPR 2007. pp. 1-8.
Style-Content Gaussian Processes Multifactor Gaussian Process Models for Style-Content Separation
J. M. Wang, D. J. Fleet, A. Hertzmann. ICML 2007. pp. 975-982.
Composition of Complex Optimal Multi-Character Motions
C. K. Liu, A. Hertzmann, Z. Popović. SCA 2006. pp. 215-222.
Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis.
B. Allen, B. Curless, Z. Popović, A. Hertzmann. SCA 2006. pp. 147-156.
Removing Camera Shake Removing Camera Shake From A Single Photograph
R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, W. T. Freeman. ACM Trans. on Graphics (Proc. SIGGRAPH 2006). July 2006. 25(3):787-794.
Segmentation-Based 3D Artistic Rendering
A. Kolliopoulos, J. M. Wang, A. Hertzmann. Proc. EGSR 2006. Nicosia, Cyprus. June 28, 2006. pp. 361-370.
Learning Latent Structure for Image Synthesis and Robotic Imitation Learning Shared Latent Structure for Image Synthesis and Robotic Imitation
A. P. Shon, K. Grochow, A. Hertzmann, R. Rao. NIPS 18, 2006. Vancouver, BC. pp. 1233-1240.
Person tracking with SGPLVM Priors for People Tracking from Small Training Sets
R. Urtasun, D. J. Fleet, A. Hertzmann, P. Fua. ICCV 2005. Beijing, China. October 15. pp. 403-410.
Photostereo with BRDFs Shape and Spatially-Varying BRDFs from Photometric Stereo
D. B. Goldman, B. Curless, A. Hertzmann, S. M. Seitz. ICCV 2005. Beijing, China. October 15. pp. 341-348.
Physics-based motion style Learning Physics-Based Motion Style with Nonlinear Inverse Optimization
C. K. Liu, A. Hertzmann, Z. Popović. ACM Trans. on Graphics (Proc. SIGGRAPH 2005). Los Angeles, CA. pp. 1071-1081.
Shape and Material Capture Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs
A. Hertzmann, S. M. Seitz. IEEE Trans. PAMI. August 2005. Vol. 27, No. 8, pages 1254-1264.
(Journal version of CVPR 2003 paper "Shape and Materials by Example: A Photometric Stereo Approach")
Segmental-speech processing A Segment-Based Probabilistic Generative Model of Speech
K. Achan, S. T. Roweis, A. Hertzmann, B. Frey. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2005). Philadelphia, PA. Vol.5. pages 221-224.
Style IK Style-Based Inverse Kinematics
K. Grochow, S. L. Martin, A. Hertzmann, Z. Popović. ACM Trans. on Graphics (Proc. SIGGRAPH 2004). pp. 522-531.
Rotoscoping Keyframe-Based Tracking for Rotoscoping and Animation
A. Agarwala, A. Hertzmann, D. H. Salesin, S. M. Seitz. ACM Trans. on Graphics (Proc. SIGGRAPH 2004). pp. 584-591.
Non-rigid shape reconstruction Automatic Non-Rigid 3D Modeling from Video.
L. Torresani, A. Hertzmann. Proc. ECCV 2004. Prague, Czech Republic. May, 2004. Vol. 2, pp. 299-312.
Multiview photometric stereo Example-Based Stereo with General BRDFs
A. Treuille, A. Hertzmann, S. M. Seitz. Proc. ECCV 2004. Prague, Czech Republic. May, 2004. Vol. 2, pp. 457-469.
Non-rigid Structure-From-Motion Learning Non-Rigid 3D Shape from 2D Motion
L. Torresani, A. Hertzmann, C. Bregler. Proc. NIPS 2003. Vancouver, BC. December 2003. pp. 1555-1562.
Photoflowmotion Shape and Motion under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-view Stereo
L. Zhang, B. Curless, A. Hertzmann, S. M. Seitz. Proc. ICCV 2003. Nice, France. October 2003. pp. 618-625.
Curve Analogies Curve Analogies
A. Hertzmann, N. Oliver, B. Curless, S. M. Seitz. Proc. 13th Eurographics Workshop on Rendering, Pisa, Italy. June 26-28, 2002. pp. 233-245.
Fast Paint Texture Fast Paint Texture
A. Hertzmann. NPAR 2002: Second International Symposium on Non-Photorealistic Animation and Rendering. Annecy, France. June 3-5, 2002. pp. 91-96, 161.
Image Analogies Image Analogies
A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, D. H. Salesin. SIGGRAPH 2001 Conference Proceedings. Los Angeles, California. August 12-16, 2001. pp. 327-340.
Texture synthesis on surfaces Texture and Shape Synthesis on Surfaces
L. Ying, A. Hertzmann, H. Biermann, D. Zorin. Proc. 12th Eurographics Workshop on Rendering, London, June 25-27, 2001. pp. 301-312.
Paint By Relaxation Paint by Relaxation
A. Hertzmann. Proc. Computer Graphics International 2001. Hong Kong. July 3-6. pp. 47-54.
Illustrating smooth surfaces Illustrating smooth surfaces
A. Hertzmann, D. Zorin. SIGGRAPH 2000 Conference Proceedings. New Orleans, Louisiana. July 23-28, 2000. pp. 517-526.
Style machines Style machines
M. Brand, A. Hertzmann. SIGGRAPH 2000 Conference Proceedings. New Orleans, Louisiana. July 23-28, 2000. pp. 183-192
Painterly Video Painterly Rendering for Video and Interaction
A. Hertzmann, K. Perlin. NPAR 2000: First International Symposium on Non-Photorealistic Animation and Rendering. Annecy, France. June 5-7, 2000. pp. 7-12, 121.
Videos from this paper.
JFK's face in 3D (more or less) Recovering Non-Rigid 3D Shape from Image Streams
C. Bregler, A. Hertzmann, H. Biermann. Proc. IEEE CVPR 2000. Hilton Head Island, South Carolina. June 13-15, 2000. pp. 690-696.
Painterly Rendering Painterly Rendering with Curved Brush Strokes of Multiple Sizes
A. Hertzmann. SIGGRAPH 98 Conference Proceedings. pp. 453-460. Orlando, Florida. July, 1998.

Tutorials and Manifestos

Computer Graphics Lecture Notes
D. Fleet and A. Hertzmann. CSC 418/2504 Lecture notes.
Introduction to Bayesian Learning Introduction to Bayesian Learning
A. Hertzmann. SIGGRAPH 2004 Course Notes.
Machine learning for computer graphics Machine Learning for Computer Graphics: A Manifesto and Tutorial
A. Hertzmann. Proc. Pacific Graphics 2003. Invited paper. Banff, Alberta. October 2003. pp. 22-36.
Stroke-Based Rendering A Survey of Stroke-Based Rendering
A. Hertzmann. IEEE Computer Graphics & Applications, Special Issue on Non-Photorealistic Rendering. July/August, 2003 (Vol. 23, No. 4). pp. 70-81.
Intro to 3D NPR Introduction to 3D Non-Photorealistic Rendering: Silhouettes and Outlines
A. Hertzmann. In S. Green, editor, Non-Photorealistic Rendering. SIGGRAPH 99 Course Notes. August 9, 1999.

Technical Reports

Shape and BRDF recovery Shape and Spatially-Varying BRDFs From Photometric Stereo
D. Goldman, B. Curless, A. Hertzmann, S. Seitz. University of Washington UW-CSE-04-05-03. May 2004.
Data synthesis with EM Data Synthesis with Expectation-Maximization
A. Hertzmann. University of Toronto Tech Report DGP-TR-2004-001. June 30, 2004.
Interactive 3D Reconstruction Interactive 3D Scene Reconstruction from Images
A. Hertzmann. NYU CS Technical Report 1999-783. April 22, 1999.
Remote Navigation Stateless Remote Environment Navigation with View Compression
H. Biermann, A. Hertzmann, J. Meyer, K. Perlin. NYU CS Technical Report 1999-784. April 22, 1999.
Kinematic Image-Based Rendering Hybrid rigid and non-rigid image-based modeling of articulated figures
A. Hertzmann, T. Darrell. Interval Research Corporation Technical Report 1998-045.

Thesis

Thesis Algorithms for Rendering in Artistic Styles
PhD thesis. New York University. May, 2001.
Janet Fabri Award for Outstanding Dissertation in Computer Science, New York University, 2002