Aaron Hertzmann's research

My papers on Google Scholar

Selected Publications

Learning Hierarchical Shape Segmentation and Labeling from Online Repositories
L. Yi, L. Guibas, A. Hertzmann, V. G. Kim, H. Su, E. Yumer.
ACM Trans. on Graphics (Proc. SIGGRAPH). 2017.
Vremiere: In-headset Virtual Reality Video Editing
C. Nguyen, S. DiVerdi, A. Hertzmann, F. Liu.
Proc. SIGCHI Conference on Human Factors in Computing Systems (CHI). 2017.
Honorable Mention Award
Controlling Perceptual Factors in Neural Style Transfer
L. Gatys, A. S. Ecker, M. Bethge, A. Hertzmann, E. Shechtman.
Proc. Computer Vision and Pattern Recognition (CVPR). 2017.
A Joint Model for Who-to-Follow and What-to-View Recommendations on Behance
M. Rudolph, M. D. Hoffman, A. Hertzmann.
Proc. MSM. 2016.
Automatic Portrait Segmentation for Image Stylization
X. Shen, A. Hertzmann, J. Jia, S. Paris, B. Price, E. Shechtman, I. Sachs.
Proc. Eurographics (EG). 2016.
Style-Based Exploration of Illustration Datasets
E. Garces, A. Agarwala, A. Hertzmann, D. Gutierrez.
Multimedia Tools and Applications. 2016.
Deep Classifiers from Image Tags in the Wild
H. Izadinia, B. C. Russell, A. Farhadi, M. D. Hoffman, A. Hertzmann.
Proc. Multimedia COMMONS. 2015.
Style Compatibility For 3D Furniture Models
T. Liu, A. Hertzmann, W. Li, T. Funkhouser.
ACM Trans. on Graphics (Proc. SIGGRAPH). 2015.
DesignScape: Design with Interactive Layout Suggestions
P. O'Donovan, A. Agarwala, A. Hertzmann.
Proc. SIGCHI Conference on Human Factors in Computing Systems (CHI). 2015.
MatrixWave: Visual Comparison of Event Sequence Data
J. Zhao, Z. Liu, M. Dontcheva, A. Hertzmann, A. Wilson.
Proc. SIGCHI Conference on Human Factors in Computing Systems (CHI). 2015.
Honorable Mention Award
Predicting Range of Acceptable Photographic Tonal Adjustments
R. Jaroensri, S. Paris, A. Hertzmann, V. Bychkovsky, F. Durand.
Proc. Int. Conf. Computational Photography (ICCP). 2015.
Learning Style Similarity for Searching Infographics
B. Saleh, A. Hertzmann, M. Dontcheva, Z. Liu.
Proc. Graphics Interface (GI). 2015.
Recognizing Image Style
S. Karayev, M. Trentacoste, H. Han, A. Agarwala, T. Darrell, A. Hertzmann, H. Winnemöller.
Proc. British Machine Vision Conference (BMVC). 2014.
PortraitSketch: Face Sketching Assistance for Novices
J. Xie, A. Hertzmann, W. Li, H. Winnemöller.
Proc. User Interface Software and Technology (UIST). 2014.
Selected for presentation at SIGGRAPH 2015
Computing Smooth Surface Contours with Accurate Topology
P. Bénard, A. Hertzmann, M. Kass.
ACM Trans. on Graphics (TOG). 2014. Volume 33, Issue 2.
Exploratory Font Selection Using Crowdsourced Attributes
P. O'Donovan, J. Lībeks, A. Agarwala, A. Hertzmann.
ACM Trans. on Graphics (Proc. SIGGRAPH). 2014.
A Similarity Measure for Illustration Style
E. Garces, A. Agarwala, D. Gutierrez, A. Hertzmann.
ACM Trans. on Graphics (Proc. SIGGRAPH). 2014.
Collaborative Filtering of Color Aesthetics
P. O'Donovan, A. Agarwala, A. Hertzmann.
Proc. Computational Aesthetics (CAe). 2014.
User-Specific Hand Modeling from Monocular Depth Sequences
J. Taylor, R. Stebbing, V. Ramakrishna, C. Keskin, J. Shotton, S. Izadi, A. Hertzmann, A. Fitzgibbon.
Proc. Computer Vision and Pattern Recognition (CVPR). 2014.
Learning Layouts for Single-Page Graphic Designs
P. O'Donovan, A. Agarwala, A. Hertzmann.
IEEE Trans. Visualization and Computer Graphics (TVCG). August 2014, Vol. 20(8).
Feedback Control for Rotational Movements in Feature Space
M. Al Borno, E. Fiume, A. Hertzmann, M. de Lasa.
Proc. Eurographics (EG). 2014.
Learning Latent Factor Models of Human Travel
M. Guerzhoy, A. Hertzmann.
Proc. Canadian Conference on Artificial Intelligence (AI). 2014.
Best Paper Award
Efficient Optimization for Sparse Gaussian Process Regression
Y. Cao, M. Brubaker, D. J. Fleet, A. Hertzmann.
IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). In press.
(Journal version of NIPS 2013 paper)
Metric Regression Forests for Correspondence Estimation
G. Pons-Moll, J. Taylor, J. Shotton, A. Hertzmann, A. Fitzgibbon.
Int. J. Computer Vision (IJCV). In press.
(Journal version of BMVC 2013 paper; Best Science Paper Award)
Trajectory Optimization for Full-Body Movements with Complex Contacts
M. Al Borno, M. de Lasa, A. Hertzmann.
IEEE Trans. Visualization and Computer Graphics (TVCG). Vol. 19, No. 8. Aug 2013.
Image-Based Remodeling
A. Colburn, A. Agarwala, A. Hertzmann, B. Curless, M. F. Cohen.
IEEE Trans. Visualization and Computer Graphics (TVCG). Jan. 2013 (vol. 19 no. 1). pp. 56-66.
[video]
AniPaint: Interactive Painterly Animation from Video
P. O'Donovan, A. Hertzmann.
IEEE Trans. Visualization and Computer Graphics (TVCG). March 2012. Vol. 18, No. 3.
Learning Hatching for Pen-and-Ink Illustration of Surfaces
E. Kalogerakis, D. Nowrouzezahrai, S. Breslav, A. Hertzmann.
ACM Trans. on Graphics (TOG). Jan. 2012. Vol. 31, No. 1.
Color Compatibility From Large Datasets
P. O'Donovan, A. Agarwala, A. Hertzmann.
ACM Trans. on Graphics (Proc. SIGGRAPH). Aug. 2011.
Feature-Based Locomotion Controllers
M. de Lasa, I. Mordatch, A. Hertzmann.
ACM Trans. on Graphics (Proc. SIGGRAPH). July 2010.
Robust Physics-Based Locomotion Using Low-Dimensional Planning
I. Mordatch, M. de Lasa, A. Hertzmann.
ACM Trans. on Graphics (Proc. SIGGRAPH). July 2010.
Optimizing Walking Controllers for Uncertain Inputs and Environments
J. M. Wang, D. J. Fleet, A. Hertzmann.
ACM Trans. on Graphics (Proc. SIGGRAPH). July 2010.
Learning 3D Mesh Segmentation and Labeling
E. Kalogerakis, A. Hertzmann, K. Singh.
ACM Trans. on Graphics (Proc. SIGGRAPH). July 2010.
Shape and Spatially-Varying BRDFs from Photometric Stereo
D. B. Goldman, B. Curless, A. Hertzmann, S. M. Seitz.
IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). June 2010.
(Journal version of ICCV 2005 paper)
Non-Photorealistic Rendering and the Science of Art
A. Hertzmann.
Proc. Non-Photorealistic Animation and Rendering (NPAR). 2010.
Physics-Based Person Tracking Using the Anthropomorphic Walker
M. Brubaker, D. J. Fleet, A. Hertzmann.
Int. J. Computer Vision (IJCV). March 2010. Vol. 87, Nos. 1-2.
(Journal version of CVPR 2007 paper)
Optimizing Walking Controllers
J. M. Wang, D. J. Fleet, A. Hertzmann.
ACM Trans. on Graphics (Proc. SIGGRAPH Asia). Dec. 2009. Vol. 28, No. 5.
Prioritized Optimization for Task-Space Control
M. de Lasa, A. Hertzmann.
Proc. IEEE/RSJ Int. Conf. on Intelligent Robots and Systems (IROS). 2009.
Image Sequence Geolocation with Human Travel Priors
E. Kalogerakis, O. Vesselova, J. Hays, A. A. Efros, A. Hertzmann.
Proc. Int. Conf. on Computer Vision (ICCV). 2009.
Data-driven curvature for real-time line drawing of dynamic scenes
E. Kalogerakis, D. Nowrouzezahrai, P. Simari, J. McCrae, A. Hertzmann, K. Singh.
ACM Trans. on Graphics (TOG). Jan. 2009. Vol. 28, No. 1.
Non-Rigid Structure-From-Motion: Estimating Shape and Motion with Hierarchical Priors
L. Torresani, A. Hertzmann, C. Bregler.
IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). May 2008. Vol. 30, No. 5. pp. 878-892.
(Journal paper based on CVPR 00, 01, and NIPS 2003 papers)
Gaussian Process Dynamical Models for Human Motion
J. M. Wang, D. J. Fleet, A. Hertzmann.
IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). Feb 2008. Vol. 30, No. 2. pp. 283-298.
(Journal version of NIPS 2006 paper)
Shape from Video: Dense Shape, Texture, Motion and Lighting from Monocular Image Streams
A. Lakdawalla, A. Hertzmann.
Proc. Workshop on Photometric Analysis on Computer Vision (WACV). 2007.
Specifying Label Layout Styles by Example
I. Vollick, D. Vogel, M. Agrawala, A. Hertzmann.
Proc. User Interface Software and Technology (UIST). 2007. pp. 221-230.
Active Learning for Real-Time Motion Controllers
S. Cooper, A. Hertzmann, Z. Popović.
ACM Trans. on Graphics (Proc. SIGGRAPH). 2007.
Isophote Distance: A Shading Approach to Artistic Stroke Thickness
T. Goodwin, I. Vollick, A. Hertzmann.
Proc. Non-Photorealistic Animation and Rendering (NPAR). 2007. pp. 53-62.
Multifactor Gaussian Process Models for Style-Content Separation
J. M. Wang, D. J. Fleet, A. Hertzmann.
Proc. International Conference on Machine Learning (ICML). 2007. pp. 975-982.
Composition of Complex Optimal Multi-Character Motions
C. K. Liu, A. Hertzmann, Z. Popović.
Proc. Symposium on Computer Animation (SCA). 2006. pp. 215-222.
Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis
B. Allen, B. Curless, Z. Popović.
Proc. Symposium on Computer Animation (SCA). 2006. pp. 147-156.
Removing Camera Shake From A Single Photograph
R. Fergus, B. Singh, A. Hertzmann, S. T. Roweis, W. T. Freeman.
ACM Trans. on Graphics (Proc. SIGGRAPH). 2006. 25(3):787-794.
Segmentation-Based 3D Artistic Rendering
A. Kolliopoulos, J. M. Wang, A. Hertzmann.
Proc. Eurographics Symposium on Rendering (EGSR). 2006. pp. 381-370.
Learning Shared Latent Structure for Image Synthesis and Robotic Imitation
A. P. Shon, K. Grochow, A. Hertzmann, R. P. N. Rao.
Proc. Neural Information Processing Systems (NIPS). 2006. pp 1233-1240.
Priors for People Tracking from Small Training Sets
R. Urtasun, D. J. Fleet, A. Hertzmann, P. Fua.
Proc. Int. Conf. on Computer Vision (ICCV). 2005. pp. 403-410.
Learning Physics-Based Motion Style with Nonlinear Inverse Optimization
C. K. Liu, A. Hertzmann, Z. Popović.
ACM Trans. on Graphics (Proc. SIGGRAPH). 2005. pp. 1071-1081.
Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs
A. Hertzmann, S. M. Seitz.
IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). 2005. Vol. 27, No. 8. pp. 1254-1264.
Journal version of CVPR 2003 paper
A Segment-Based Probabilistic Generative Model of Speech
K. Achan, S. T. Roweis, A. Hertzmann, B. Frey.
Proc. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP). 2005. Vol. 5, pages 221-224.
Style-Based Inverse Kinematics
K. Grochow, S. L. Martin, A. Hertzmann, Z. Popović.
ACM Trans. on Graphics (Proc. SIGGRAPH). 2004. pp. 552-531.
Keyframe-Based Tracking for Rotoscoping and Animation
A. Agarwala, A. Hertzmann, D. H. Salesin, S. M. Seitz.
ACM Trans. on Graphics (Proc. SIGGRAPH). 2004. pp. 584-591.
Automatic Non-Rigid 3D Modeling from Video
L. Torresani, A. Hertzmann.
Proc. European Conf. on Computer Vision (ECCV). 2004. Vol. 2, pp. 299-312.
Example-Based Stereo with General BRDFs
A. Treuille, A. Hertzmann, S. M. Seitz.
Proc. European Conf. on Computer Vision (ECCV). 2004. Vol. 2, pp. 457-469.
Learning Non-Rigid 3D Shape from 2D Motion
L. Torresani, A. Hertzmann, C. Bregler.
Proc. Neural Information Processing Systems (NIPS). 2003. pp. 1555-1562.
Shape and Motion under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-view Stereo
L. Zhang, B. Curless, A. Hertzmann, S. M. Seitz.
Proc. Int. Conf. on Computer Vision (ICCV). 2003. pp. 618-625.
Curve Analogies
A. Hertzmann, N. Oliver, S. M. Seitz, B. Curless.
Proc. Eurographics Workshop on Rendering (EGWR). 2002. pp. 233-245.
Fast Paint Texture
A. Hertzmann.
Proc. Non-Photorealistic Animation and Rendering (NPAR). 2002. pp. 91-96, 161.
Image Analogies
A. Hertzmann, C. E. Jacobs, N. Oliver, B. Curless, D. H. Salesin.
SIGGRAPH Conference Proceedings. 2001. pp. 327-340.
Texture and Shape Synthesis on Surfaces
L. Ying, A. Hertzmann, H. Biermann, D. Zorin.
Proc. Eurographics Workshop on Rendering (EGWR). 2001. pp. 301-312..
Paint By Relaxation
A. Hertzmann.
Proc. Computer Grahics International (CGI). 2001. pp. 47-54.
Illustrating smooth surfaces
A. Hertzmann, D. Zorin.
SIGGRAPH Conference Proceedings. 2000. pp. 517-526.
Style machines
M. Brand, A. Hertzmann.
SIGGRAPH Conference Proceedings. 2000. pp. 183-192.
Painterly Rendering for Video and Interaction
A. Hertzmann, K. Perlin.
Proc. Non-Photorealistic Animation and Rendering (NPAR). 2000. pp. 7-12, 121.
[Videos]
Recovering Non-Rigid 3D Shape from Image Streams
C. Bregler, A. Hertzmann, H. Biermann.
Proc. Computer Vision and Pattern Recognition (CVPR). 2000. pp. 690-696.
Painterly Rendering with Curved Brush Strokes of Multiple Sizes
A. Hertzmann.
SIGGRAPH Conference Proceedings. 1998. pp. 453-460.

Tutorials

Machine Learning lecture notes
A. Hertzmann.
CSC 411 course notes.
Computer Graphics lecture notes
D. J. Fleet, A. Hertzmann.
CSC 418 course notes.
Introduction to Bayesian Learning
A. Hertzmann.
SIGGRAPH Course Notes. 2004.
Machine Learning for Computer Graphics: A Manifesto and Tutorial
A. Hertzmann.
Proc. Pacific Graphics (PG). 2003. pp. 22-36. Invited paper..
A Survey of Stroke-Based Rendering
A. Hertzmann.
IEEE Computer Graphics & Applications (CG&A). July/August 2003. Vol. 23, No. 4. pp. 70-81.
Introduction to 3D Non-Photorealistic Rendering: Silhouettes and Outlines
A. Hertzmann.
In S. Green, editor, Non-Photorealistic Rendering. SIGGRAPH 99 Course Notes.. 1999.

Technical Reports

Data Synthesis with Expectation-Maximization
A. Hertzmann.
University of Toronto Tech Report DGP-TR-2004-001. 2004.
Interactive 3D Scene Reconstruction from Images
A. Hertzmann.
NYU CS Technical Report 1999-783. 1999.
Stateless Remote Environment Navigation with View Compression
H. Biermann, A. Hertzmann, J. Meyer, K. Perlin.
NYU CS Technical Report 1999-784. 1998.
Hybrid rigid and non-rigid image-based modeling of articulated figures
A. Hertzmann, T. Darrell.
Interval Research Corporation Technical Report 1998-045. 1998.

Thesis

Algorithms for Rendering in Artistic Styles
A. Hertzmann.
PhD thesis. New York University. May 2001.
Janet Fabri Award for Outstanding Dissertation in Computer Science, New York University, 2002