Aaron Hertzmann


Education

Ph.D., Computer Science, May 2001.
New York University, New York, NY
Thesis: Algorithms for Rendering in Artistic Styles
Thesis advisors: Ken Perlin and Denis Zorin

M.S. Computer Science, January 1998
New York University, New York, NY

B.A. Computer Science and Art & Art History, May 1996
Rice University, Houston, TX


Current Position

Principal Scientist, Adobe Systems. San Francisco, CA. (Senior Research Scientist: October 2012-August 2016; Principal Scientist: Sep 2016-present).


Experience

Professor, University of Toronto Computer Science Department, Toronto, ON. (Assistant: Jan 2003-June 2007; Associate: July 2007-June 2012; Full: July 2012-October 2013)

Visiting Research Scientist, Pixar Animation Studios, Emeryville, CA. June 2009-February 2010.

Acting Assistant Professor, University of Washington Computer Science and Engineering Department, Seattle, WA. Fall 2001 to December 2002.

Research Intern, Microsoft Research, Redmond, WA. Summer, 2000.

Research Assistant, Stanford Computer Science Department, Stanford, CA. Spring, 2000.

Summer Intern, Mitsubishi Electric Research Laboratory, Cambridge, MA. Summer, 1999

Summer Intern, Interval Research Corporation, Palo Alto, CA. Summer, 1998

Summer Intern, NEC Research Institute, Princeton, NJ. Summer, 1997

Software Engineer, Stellartech Research Corporation, Mountain View, CA. Summer and Winter Breaks, 1992-1996

Student Researcher, Rice University Computer Science Department, Houston, TX. Summer, 1996

Awards and Honors

CHI Honorable Mention Paper Award, 2017

CHI Honorable Mention Paper Award, 2015

Canadian Conference on AI Best Paper Award, 2014

BMVC Best Science Paper Award, 2013

Rice Outstanding Young Engineering Alumnus, 2011

Steacie Prize for Natural Sciences, 2010

CACS/AIC Outstanding Young CS Researcher Award, 2009

University of Toronto Computer Science Student Union Teaching Award, 2008

Microsoft New Faculty Fellowship, 2006

Alfred P. Sloan Fellowship, 2006

Ontario Early Researcher Award, 2005

TR100: MIT Technology Review's 100 Top Young Innovators Under 35, 2004

Janet Fabri Memorial Award for Outstanding Dissertation in Computer Science, New York University, 2002

First Place, ACM/IBM Quest for Java '97

Departmental Fellowship, Courant Institute of Mathematical Sciences, 1996

Member of winning team, ACM Regional Programming Contest, 1993

Member of third place team, ACM Regional Programming Contest, 1995

Professional Activities

Affiliate/Status-Only faculty:
Professor, University of Washington Computer Science and Engineering Department (September 2005-present)
Professor, University of Toronto Computer Science Department (October 2013-present)

Professional societies:
ACM Distinguished Scientist (2015-present)
IEEE Senior Member (2012-present)
Fellow, Canadian Institute for Advanced Research (Associate member/Scholar: 2006-2010; Fellow: 2010-2013)

Editorial boards:
Associate Editor, ACM Transactions on Graphics (2009 to present)
Associate Editor, IEEE Transactions on Visualization and Computer Graphics (2006 to 2009)
Associate Editor, Foundations and Trends in Computer Graphics and Vision (2004 to present)

Conference and workshop co-chair:
Pacific Graphics 2013, Singapore
Symposium on Non-Photorealistic Animation and Rendering (NPAR 2004), Annecy, France
NIPS 2004 Workshop on Learning in Graphics and Vision, Whistler, BC

Conference program committees:
ACM SIGGRAPH 2003, 2004, 2006, 2007 (Area Coordinator), 2009, 2011, 2012, 2014, 2015
ACM SIGGRAPH Asia 2008, 2011
International Conference on Computer Vision (ICCV) 2013
European Conference on Computer Vision (ECCV) 2008, 2012
Computer Vision and Pattern Recognition (CVPR) 2009
Eurographics Symposium on Rendering 2003, 2006, 2007
International Symposium on Non-Photorealistic Animation and Rendering (NPAR) 2002, 2006, 2007, 2008
ACM/Eurographics Symposium on Computer Animation (SCA) 2005, 2006, 2007
Pacific Graphics 2002, 2004
Graphics Interface 2004

Guest Editor:
IEEE CG&A Special Issue on Physics-Based Characters. vol. 31, no. 1, July/August 2011 (co-editor)

Juries:
Annecy International Animated Film Festival 2004, Internet films division


Scientific Publications

Refereed journal papers

Elena Garces, Aseem Agarwala, Aaron Hertzmann, Diego Gutierrez. Style-Based Exploration of Illustration Datasets. Multimedia Tools and Applications. 2016.

Tianqiang Liu, Aaron Hertzmann, Wilmot Li, Thomas Funkhouser. Style Compatibility For 3D Furniture Models. ACM Trans. Graphics (Proc. SIGGRAPH 2015).

Gerard Pons-Moll, Jonathan Taylor, Jamie Shotton, Aaron Hertzmann, Andrew Fitzgibbon. Metric Regression Forests for Correspondence Estimation. Int. J. Comp. Vision. In press.

Yanshuai Cao, Marcus Brubaker, David J. Fleet, Aaron Hertzmann. Efficient Optimization for Sparse Gaussian Process Regression IEEE Trans. Pattern Analysis and Machine Intelligence (PAMI). In press.

Pierre Bénard, Aaron Hertzmann, Michael Kass. Computing Smooth Surface Contours with Accurate Topology, ACM Transactions on Graphics (TOG). 2014. Volume 33, Issue 2.

Peter O'Donovan, Jānis Lībeks, Aseem Agarwala, Aaron Hertzmann. Exploratory Font Selection Using Crowdsourced Attributes. ACM Trans. on Graphics (Proc. SIGGRAPH). 2014. Vol. 33(4)

Elena Garces, Aseem Agarwala, Diego Gutierrez, Aaron Hertzmann. A Similarity Measure for Illustration Style. ACM Trans. on Graphics (Proc. SIGGRAPH). 2014. Vol. 33(4)

Peter O'Donovan, Aseem Agarwala, Aaron Hertzmann. Learning Layouts for Single-Page Graphic Designs, IEEE Transactions on Visualization and Computer Graphics (TVCG). Vol. 20(8), August 2014.

Mazen Al Borno, Martin de Lasa, Aaron Hertzmann. Trajectory Optimization for Full-Body Movements with Complex Contacts, IEEE Transactions on Visualization and Computer Graphics (TVCG). Vol. 19, No. 8. Aug 2013.

Alex Colburn, Aseem Agarwala, Aaron Hertzmann, Brian Curless, Michael F. Cohen. Image-Based Remodeling. IEEE Trans. Visualization and Computer Graphics. Jan. 2013 (vol. 19 no. 1). pp. 56-66.

Evangelos Kalogerakis, Derek Nowrouzezahrai, Simon Breslav, Aaron Hertzmann. Learning Hatching for Pen-and-Ink Illustration of Surfaces. ACM Trans. Graphics. Vol. 31, No. 1. 2012

Peter O'Donovan, Aseem Agarwala, Aaron Hertzmann. Color Compatibility From Large Datasets. ACM Trans. Graphics (Proc. SIGGRAPH). 2011.

Peter O'Donovan, Aaron Hertzmann. AniPaint: Interactive Painterly Animation from Video. IEEE Trans. Visualization and Computer Graphics. March 2012. Vol. 18, No. 3. pages 475-487.

Martin de Lasa, Igor Mordatch, Aaron Hertzmann. Feature-Based Locomotion Controllers. ACM Trans. Graphics (Proc. SIGGRAPH). July 2010.

Igor Mordatch, Martin de Lasa, Aaron Hertzmann. Robust Physics-Based Locomotion Using Low-Dimensional Planning. ACM Trans. Graphics (Proc. SIGGRAPH). July 2010.

Jack M. Wang, David J. Fleet, Aaron Hertzmann. Optimizing Walking Controllers for Uncertain Inputs and Environments. ACM Trans. Graphics (Proc. SIGGRAPH). July 2010.

Evangelos Kalogerakis, Aaron Hertzmann, Karan Singh. Learning 3D Mesh Segmentation and Labeling. ACM Trans. Graphics (Proc. SIGGRAPH). July 2010.

Dan B Goldman, Brian Curless, Aaron Hertzmann, Steven M. Seitz. Shape and Spatially-Varying BRDFs From Photometric Stereo. IEEE Trans. PAMI. June 2010.

Marcus A. Brubaker, David J. Fleet, Aaron Hertzmann. Physics-based Person Tracking Using the Anthropomorphic Walker. International Journal of Computer Vision. March 2010. Vol. 87, Nos 1-2.

Jack M. Wang, David J. Fleet, Aaron Hertzmann. Optimizing Walking Controllers. ACM Trans. on Graphics (Proc. SIGGRAPH Asia 2009). Vol. 28, No. 5. December 2009.

Evangelos Kalogerakis, Derek Nowrouzezahrai, Patricio Simari, James McCrae, Aaron Hertzmann, Karan Singh. Data-driven curvature for real-time line drawing of dynamic scenes. ACM Trans. on Grahics. January 2009. Vol. 28, No. 1.

Lorenzo Torresani, Aaron Hertzmann, Christoph Bregler. Non-Rigid Structure-From-Motion: Estimating Shape and Motion with Hierarchical Priors. IEEE Trans. PAMI. May 2008. Vol. 30, No. 5. pp. 878-892.

Jack M. Wang, David J. Fleet, Aaron Hertzmann. Gaussian Process Dynamical Models for Human Motion. IEEE Trans. PAMI. February 2008. Vol. 30, No. 2. pp. 283-298.

Seth Cooper, Aaron Hertzmann, Zoran Popović. Active Learning for Real-Time Motion Controllers. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2007.

Rob Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis, William T. Freeman. Removing Camera Shake From A Single Photograph. ACM Trans. on Graphics (Proc. SIGGRAPH). July 2006. 25(3):787-794.

C. Karen Liu, Aaron Hertzmann, Zoran Popović. Learning Physics-Based Motion Style with Nonlinear Inverse Optimization ACM Trans. on Graphics (Proc. SIGGRAPH). 2005. pp. 1071-1081.

Aaron Hertzmann, Steven M. Seitz. Example-Based Photometric Stereo: Shape Reconstruction with General, Varying BRDFs. IEEE Trans. PAMI, August 2005. Vol. 27, No. 8, pp. 1254-1264.

Aseem Agarwala, Aaron Hertzmann, David H. Salesin, Steven M. Seitz. Keyframe-Based Tracking for Rotoscoping and Animation. ACM Trans. on Graphics (Proc. SIGGRAPH). 2004. pp. 584-591.

Keith Grochow, Steven L. Martin, Aaron Hertzmann, Zoran Popović. Style-Based Inverse Kinematics. ACM Trans. on Graphics (Proc. SIGGRAPH). 2004. pp. 522-531.

Reviewed conference papers

Cuong Nguyen, Stephen DiVerdi, Aaron Hertzmann, and Feng Liu. Vremiere: In-headset Virtual Reality Video Editing. Proc. CHI 2017

Maja Rudolph, Matthew D. Hoffman, Aaron Hertzmann. A Joint Model for Who-to-Follow and What-to-View Recommendations on Behance. Proc. MSM. 2016.

Xiaoyong Shen, Aaron Hertzmann, Jiaya Jia, Sylvain Paris, Brian Price, Eli Shechtman, Ian Sachs. Automatic Portrait Segmentation for Image Stylization. Proc. Eurographics 2016.

Hamid Izadinia, Bryan Russell, Ali Farhadi, Matthew D. Hoffman, Aaron Hertzmann. Deep Classifiers from Image Tags in the Wild. Proc. Multimedia Commons 2015

Peter O'Donovan, Aseem Agarwala, Aaron Hertzmann. DesignScape: Design with Interactive Layout Suggestions. Proc. CHI 2015

Jian Zhao, Zhicheng Liu, Mira Dontcheva, Aaron Hertzmann, Alan Wilson. MatrixWave: Visual Comparison of Event Sequence Data. Proc. CHI 2015

Ronnachai Jaroensri, Sylvain Paris, Aaron Hertzmann, Vladimiar Bychkovsky, Frédo Durand. Predicting Range of Acceptable Photographic Tonal Adjustments. Proc. ICCP 2015

Babak Saleh, Aaron Hertzmann, Mira Dontcheva, Zhicheng Liu. Learning Style Similarity for Searching Infographics. Proc. GI 2015

Sergey Karayev, Matthew Trentacoste, Helen Han, Aseem Agarwala, Trevor Darrell, Aaron Hertzmann, Holger Winnemöller. Recognizing Image Style. Proc. BMVC 2014.

Jun Xie, Aaron Hertzmann, Wilmot Li, Holger Winnemöller. PortraitSketch: Face Sketching Assistance for Novices. Proc. UIST 2014.

Peter O'Donovan, Aseem Agarwala, Aaron Hertzmann. Collaborative Filtering of Color Aesthetics. Proc. Computational Aesthetics (CAe). 2014.

Jonathan Taylor, Richard Stebbing, Varun Ramakrishna, Cem Keskin, Jamie Shotton, Shahram Izadi, Aaron Hertzmann, Andrew Fitzgibbon. User-Specific Hand Modeling from Monocular Depth Sequences. Proc. CVPR 2014.

Michael Guerzhoy and Aaron Hertzmann. Learning Latent Factor Models of Human Travel for Travel Prediction and Analysis. In Proc. of the Canadian Conference on Artificial Intelligence, May 2014, Montreal, Quebec.

Mazen Al Borno, Eugene Fiume, Aaron Hertzmann, Martin de Lasa. Feedback Control for Rotational Movements in Feature Space. Proc. Eurographics 2014

Yanshuai Cao, Marcus Brubaker, David J. Fleet, Aaron Hertzmann. Efficient Optimization for Sparse Gaussian Process Regression. NIPS 2013.

Gerard Pons-Moll, Jonathan Taylor, Jamie Shotton, Aaron Hertzmann, Andrew Fitzgibbon. Metric Regression Forests for Human Pose Estimation. British Machine Vision Conference (BMVC) 2013.

Aaron Hertzmann. Non-Photorealistic Rendering and the Science of Art. NPAR 2010.

Martin de Lasa, Aaron Hertzmann. Prioritized Optimization for Task-Space Control. IROS 2009.

Evangelos Kalogerakis, Olga Vesselova, James Hays, Alexei A. Efros, Aaron Hertzmann. Image Sequence Geolocation with Human Travel Priors. ICCV 2009.

Ian Vollick, Daniel Vogel, Maneesh Agrawala, Aaron Hertzmann. Specifying Label Layout Styles by Example. UIST 2007. pp. 221-230.

Todd Goodwin, Ian Vollick, Aaron Hertzmann. Isophote Distance: A Shading Approach to Artistic Stroke Thickness. NPAR 2007. August 2007. pp. 53-62.

Marcus Brubaker, David J. Fleet, Aaron Hertzmann. Physics-Based Person Tracking Using Simplified Lower-Body Dynamics. CVPR 2007. June 2007. pp. 1-8.

Jack M. Wang, David J. Fleet, Aaron Hertzmann. Multifactor Gaussian Process Models for Style-Content Separation. ICML 2007. June 2007. pp. 975-982

C. Karen Liu, Aaron Hertzmann, Zoran Popović. Composition of Complex Optimal Multi-Character Motions. SCA 2006. pp. 215-222.

Brett Allen, Brian Curless, Zoran Popović, Aaron Hertzmann. Learning a correlated model of identity and pose-dependent body shape variation for real-time synthesis. SCA 2006. pp. 147-156.

Alexander Kolliopoulos, Jack M. Wang, Aaron Hertzmann. Segmentation-Based 3D Artistic Rendering. EGSR 2006. Nicosia, Cyprus. June 28, 2006. pp. 361-370.

Jack M. Wang, David J. Fleet, Aaron Hertzmann. Gaussian Process Dynamical Models. NIPS 18, 2006. pp. 1441-1448.

Aaron P. Shon, Keith Grochow, Aaron Hetzmann, Rajesh P. N. Rao. Learning Shared Latent Structure for Image Synthesis and Robotic Imitation, NIPS 18, 2006. pp. 1233-1240.

Raquel Urtasun, David J. Fleet, Aaron Hertzmann, Pascal Fua. Priors for People Tracking from Small Training Sets. ICCV 2005. Beijing, China. October 18. pp. 403-410.

Daniel B. Goldman, Brian Curless, Aaron Hertzmann, Steven M. Seitz. Shape and Spatially-Varying BRDFs from Photometric Stereo. ICCV 2005. Beijing, China. October 18. pp 341-348.

Kannan Achan, Sam Roweis, Aaron Hertzmann, Brendan Frey. A Segment-Based Probabilistic Generative Model of Speech. IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2005). Philadelphia, PA. Vol.5, pages 221-224.

Lorenzo Torresani, Aaron Hertzmann. Automatic Non-Rigid 3D Modeling from Video. Proc. ECCV 2004. pp. 299-312. May, 2004. Prague, Czech Republic.

Adrien Treuille, Aaron Hertzmann, Steven M. Seitz. Example-Based Stereo with General BRDFs. Proc. ECCV 2004. pp. 457-469. May, 2004. Prague, Czech Republic.

Lorenzo Torresani, Aaron Hertzmann, Christoph Bregler. Learning Non-Rigid 3D Shape from 2D Motion. Proc. NIPS 2003. Vancouver, BC. pp. 1555-1562

Li Zhang, Brian Curless, Aaron Hertzmann, Steven M. Seitz. Shape and Motion under Varying Illumination: Unifying Structure from Motion, Photometric Stereo, and Multi-view Stereo. Proc. ICCV 2003. Nice, France. October 2003. pp. 618-625.

Aaron Hertzmann, Steven M. Seitz. Shape and Materials by Example: A Photometric Stereo Approach. Proc. IEEE CVPR 2003. Madison, WI. June 2003. Vol. 1. pp. 533-540.

Aaron Hertzmann, Nuria Oliver, Brian Curless, Steven M. Seitz. Curve Analogies. Proc. 13th Eurographics Workshop on Rendering, Pisa, Italy. June 26-28, 2002. pp. 233-245.

Aaron Hertzmann. Fast Paint Texture. NPAR 2002: Second International Symposium on Non-Photorealistic Animation and Rendering. Annecy, France. June 3-5, 2002. pp. 91-96, 161.

Aaron Hertzmann, Charles E. Jacobs, Nuria Oliver, Brian Curless, David H. Salesin. Image Analogies. SIGGRAPH 2001 Conference Proceedings. August 12-17, 2001. pp. 327-340.

Lexing Ying, Aaron Hertzmann, Henning Biermann, Denis Zorin. Texture and Shape Synthesis on Surfaces. Proc. 12th Eurographics Workshop on Rendering. June 25-27, 2001. pp. 301-312.

Aaron Hertzmann. Paint By Relaxation. Proc. Computer Graphics International 2001. July 3-6, 2001. pp. 47-54.

Aaron Hertzmann, Denis Zorin. Illustrating smooth surfaces. SIGGRAPH 2000 Conference Proceedings. New Orleans, Louisiana. July 2000. pp. 517-526.

Matthew Brand, Aaron Hertzmann. Style machines. SIGGRAPH 2000 Conference Proceedings. New Orleans, Louisiana. July 2000. pp. 183-192.

Christoph Bregler, Aaron Hertzmann, Henning Biermann. Recovering Non-Rigid 3D Shape from Image Streams Proc. IEEE CVPR 2000. June 13-15, 2000. pp. 690-696.

Aaron Hertzmann, Ken Perlin. Painterly Rendering for Video and Interaction. Proc. First International Symposium on Non-Photorealistic Animation and Rendering. June 5-7, 2000. pp. 7-12, 121.

Aaron Hertzmann. Painterly Rendering with Curved Brush Strokes of Multiple Sizes. SIGGRAPH 98 Conference Proceedings. July, 1998. pp. 453-460.

Reviewed workshop papers

Maja R. Rudolph, Matthew Hoffman, Aaron Hertzmann. A Joint Model for Who-to-Follow and What-to-View Recommendations on Behance. Proc. MSM 2016

Michael Guerzhoy, Aaron Hertzmann. Learning Latent Factor Models of Human Travel. NIPS 2012 Workshop on Social Network and Social Media Analysis.

Azeem Lakdawalla, Aaron Hertzmann. Shape from Video: Dense Shape, Texture, Motion and Lighting from Monocular Image Streams.. Workshop on Photometric Analysis for Computer Vision 2007. Rio de Janeiro, Brazil. 2007.

Marcus Brubaker, David J. Fleet, Aaron Hertzmann. Physics-Based Human Pose Tracking. EHuM: Evaluation of Articulated Human Motion and Pose Estimation. Whistler, BC. December, 2006.

Andrew Wright, Suresh Jagannathan, Cristian Ungureanu, Aaron Hertzmann. Compiling Java to a Typed Lambda-Calculus: A Preliminary Report. Proc. Second Intl. Workshop on Types in Compilation. Springer-Verlag LNCS 1473. March 1998. pp. 9-27.

Other publications

Leon A. Gatys, Matthias Bethge, Aaron Hertzmann, Eli Shechtman Preserving Color in Neural Artistic Style Transfer. arXiv:1606.05897. 2016

A. Hertzmann, V. Zordan. Introduction to CG&A Special Issue on Physics-Based Characters. IEEE Computer Graphics & Applications. vol. 31, no. 1, July/August 2011

Aaron Hertzmann. Introduction to Bayesian Learning. SIGGRAPH 2004 Course notes. 78 pages.

Aaron Hertzmann. Machine Learning for Computer Graphics: A Manifesto and Tutorial. Proc. Pacific Graphics 2003. Invited Paper. Banff, Alberta. October, 2003. pp. 22-36.

Aaron Hertzmann. A Survey of Stroke-Based Rendering. IEEE Computer Graphics & Applications, Special Issue on Non-Photorealistic Rendering. July/August, 2003 (Vol. 23, No. 4) pp. 70-81.

Chee Yap, Henning Biermann, Aaron Hertzmann, Chen Li, Jon Meyer, Hsing-Kuo Pao, Salvatore Paxia. A Different Manhattan Project: Automatic Statistical Model Generation. Proc. SPIE Visualization and Data Analysis 2002.

Aaron Hertzmann. Introduction to 3D Non-Photorealistic Rendering: Silhouettes and Outlines. SIGGRAPH 99 Course Notes (Course on Non-Photorealistic Rendering). August 9, 1999.

Technical reports

A. Hertzmann. Data Synthesis with Expectation-Maximization. University of Toronto Tech Report DGP-TR-2004-001. June 30, 2004.

Aaron Hertzmann. Paint by Relaxation. NYU CS Technical Report 2000-801. May, 2000

Aaron Hertzmann. Interactive 3D Scene Reconstruction from Images. NYU CS Technical Report 1999-783. April 22, 1999.

Henning Biermann, Aaron Hertzmann, Jon Meyer, Ken Perlin. Stateless Remote Environment Navigation with View Compression. NYU CS Technical Report 1999-784. April 22, 1999.

Aaron Hertzmann, Trevor Darrell. Hybrid rigid and non-rigid image-based modeling of articulated figures. Interval Research Corporation Technical Report 1998-045.

Patents

Holger Winnemoeller, Jun Xie, Wilmot Li, Aaron Hertzmann. Providing drawing assistatnce using feature detection and semantic labeling. US Patent No. 9,495,581. November 15, 2016.

Holger Winnemoeller, Jun Xie, Wilmot Li, Aaron Hertzmann. Geometrically and parametrically modifying user input to assist drawing. US Patent No. 9,305,382. April 5, 2016.

Mohammad Rastegari, Aaron Hertzmann, Elya Shechtman. Image prior as a shared basis mixture model. US Patent No. 9,159,123. Oct 13, 2015.

William T. Freeman, Robert Fergus, Barun Singh, Aaron Hertzmann, Sam T. Roweis. Removing camera shake from a single photograph using statistics of a natural image. US Patent No. 7,616,826. Nov 10, 2009.

Aaron Hertzmann, Henning Biermann, Jon Meyer, Kenneth Perlin. Stateless remote environment navigation. US Patent No. 6,628,282. Sep 30, 2003.

Aaron Hertzmann, Ken Perlin. Method and system for generating an image having a hand-painted appearance. US Patent No. 6,011,536. Jan. 2000.


Art

Animation

Painterly animation for "The Spine" (2009), directed by Chris Landreth, produced by National Film Board of Canada and Copperheart Entertainment. Credit: "NPR Consultant"

Erik Friedlander's Topaz. "Skin." DVD and VHS. Released February 14, 2000, on SIAM Records.

Painterly animation for "Nickellennium," broadcast worldwide on Nickelodeon, Jan 1, 2000.

Illustration

Illustrations for Modeling Trust Context in Networks, by Sibel Adali. Springer, 2013.

Installations

"Paint on Canvas." Digital Arts & Culture 2001 art gallery. Providence, RI. April 26-28, 2001.
Analogic Sensations: Festival for Expanded Media. New York, July 13, 2002.

"END-USER LICENSE AGREEMENT (EULA)." Digital Arts & Culture 2001 art gallery. Providence, RI. April 26-28, 2001.

Contributed to "Mass Hallucinations," work led by Trevor Darrell. Exhibitions: SIGGRAPH 98 Emerging Technologies; The Tech Museum of Innovation, San Jose, CA, Oct 1998-Mar 1999.

Teaching

Click here for courses I've taught or organized


Students

Click here for student advising


Presentations

Invited Talks

Computational Graphic Design and Aesthetics
CVPR 2013 Workshop on Visual Analysis Beyond Semantics. Invited Talk. June 28, 2013.

Feature-Based Locomotion Control
Snowbird Learning Workshop. Keynote. Snowbird, Utah. April 6, 2012.
Indian Conference on Computer Vision, Graphics and Image Processing. Plenary Talk. Chennai, India. December 13, 2010.

Removing Camera Shake from a Single Photograph
Workshop on Vision, Video, and Graphics. Invited Talk. Warwick, England. September 14, 2007.

Learning Biomechanical Models of Human Motion
University of Utah CS Department Colloquium. Salt Lake City, Utah. November 14, 2008.
Workshop on Convergence of Graphics and Vision. Keynote Talk. Informatikzentrum Schloss Dagstuhl. Wadern, Germany. April 26, 2007.
Current Trends in Computer Vision 2006. Lhasa, Tibet. August 9, 2006.
CIAR Workshop on Extracting Human Motion from Video, Toronto, ON, July 10, 2005.

Learning Pose and Motion Models for Computer Animation
Gaussian Processes in Practice Workshop. Invited Talk. Bletchley Park, UK. June 13, 2006 [video].

Art, Vision, Probability
Symposium on Computational Photography and Video, Invited Talk. Cambridge, MA. May 24, 2005.

Machine Learning for Computer Graphics
Pacific Graphics 2003. Invited Talk. Banff, AB. October 9, 2003.
CMU Robotics Institute VASC Retreat. Invited Talk. Hidden Valley Resort, PA. January 29, 2002.

Algorithms for Rendering in Artistic Styles
CAD/CG conference. Invited Talk. Kunming, China. August 24, 2001.


SIGGRAPH Course Presentations

Biomechanical Principles of Human Locomotion
SIGGRAPH 2009 Course on Realistic Human Body Movement for Emotional Expressiveness, New Orleans, LA. 2009.

Introduction to Bayesian Learning (Course Organizer)
SIGGRAPH 2004 Course on Introduction to Bayesian Learning, Los Angeles, CA. August 9, 2004.

Stroke-Based Rendering
SIGGRAPH 2002 Course on Recent Advances in Non-Photorealistic Rendering for Art and Visualization, San Antonio, TX. July 22, 2002.

Silhouettes and Outlines; Painterly Rendering
SIGGRAPH 99 Course on Non-Photorealistic Rendering, Los Angeles, CA. 1999.


Other presentations

Image Classification for Style and User-Supplied Tags
Rice University. November 26, 2014.

Computational Graphic Design and Aesthetics
San Francisco ML Meetup. January 26, 2017.
University of Oxford. September 17, 2014.
University College London. September 16, 2014.
UT Austin Computer Science Department. Austin, TX. April 18, 2014.
Tri-State Workshop on Graphics. Princeton University. Princeton, NJ. March 22, 2014.
NYU CS Department Colloquium. New York City, NY. March 14, 2014.
Rice University CS Department. Houston, Texas. November 27, 2013.
UC Berkeley CS Department. Berkeley, California. November 15, 2013.
MIT CSAIL, Cambridge, Massachusetts. October 10, 2013.

Color Compatibility from Large Datasets
ICCV AC Workshop, Oxford, England. August 29, 2013.

Research Overview
Universidad de Zaragoza, Zaragoza, Spain. March 1, 2013.
Department of Engineering Science, University of Oxford, UK. June 28, 2012.
Department of Engineering. University of Cambridge, UK. June 26, 2012.

Feature-Based Locomotion Controllers
DreamWorks Animation, Redwood City, CA, December 13, 2012.
Rice University, Houston, Texas, November 21, 2012.
Trinity College, Dublin, Ireland. August 31, 2012.
GRASP Lab, University of Pennsylvania. February 4, 2012.
University College London, England. July 13, 2011.
Microsoft Research. Cambridge, England. July, 12, 2011.
INRIA, Grenoble, France. July 7, 2011.
Sony Computer Entertainment America R&D, Foster City, CA. May 12, 2011.
Massachusetts Institute of Technology. Cambridge, MA. November 4, 2010.
Stanford University, Stanford, CA. August 31, 201.
Ben-Gurion University of the Negev, Be'er Sheba, Israel. July 6, 2010.
Hebrew University, Jerusalem, Israel, March 22, 2010.

Non-Photorealistic Rendering and the Science of Art
Stanford University Technical Training. Stanford, California. October 18, 2013.
Bellairs Workshop on Computer Animation. St. James, Barbados. February 20, 2011.
Microsoft Research Bangalore. India. December 16, 2010.
NPAR, Annecy, France, June 9, 2010.
Telefónica I+D, Barcelona, Spain, June 3, 2010.

Non-Photorealisic Rendering: Painterly Rendering and Line Drawing
Hebrew University, Jerusalem, Israel, March 18, 2010.
Pixar Animation Studios, Emeryville, CA, November 19, 2009.

Image Sequence Geolocation with Human Travel Priors
Tel Aviv University, Tel Aviv, Israel. April 27, 2010.
Weizmann Institute, Rehovot, Israel. March 25, 2010
Adobe Research, San Francisco, CA. December 4, 2009.
ICCV, Kyoto, Japan, October 1, 2009.
UC Berkeley, September 17, 2009.
New York University, April 9, 2009.
Telefónica I+D, Barcelona, Spain, January 19, 2009.

Learning Human Motion Models for Tracking and Animation
Department of Engineering. University of Oxford, UK. June 5, 2008.
Microsoft Research, Cambridge, England, September 11, 2007.
Pixar Animation Studios, Emeryville, CA, April 18, 2006.

Isophote Distance: A Shading Approach to Artistic Stroke Thickness
NPAR, San Diego, CA. August 4, 2007
Adobe Research, Seattle, WA. July 20, 2007

Example-Based Analysis and Synthesis of Shape, Reflectance, and Style
Kodak Research Laboratory, Rochester, NY, May 22, 2007.
Rice University Computer Science Department, Houston, TX, March 11, 2005.
CORE Feature Animation, Toronto, ON, March 1, 2005.
MIT CSAIL, Cambridge, MA. September 27, 2004.
Tsinghua University, Beijing, China. August 24, 2004.
Microsoft Research Asia, Beijing, China. August 23, 2004.
INRIA Rhône-Alpes, Grenoble, France. June 1, 2004.
ETH, Zürich, Switzerland. May 28, 2004.

Automatic Non-Rigid Modeling from Video
Georgia Institute of Technology. Feburary 23, 2009.
École Normal Supérieure. Paris, France. June 13, 2008.
University of Washington CSE Department. Seattle, WA. July 18, 2003.
Microsoft Research. Redmond, WA. July 3, 2003.

Removing Camera Shake from a Single Photograph
Telefónica I+D, Barcelona, Spain, June 2, 2008.
Microsoft Research, Redmond, WA, July 18, 2007. [video]
Rice University CS Department, Houston, TX, November 20, 2006.
Microsoft Research, Cambridge, UK, June 14, 2006.
Stanford Graphics Lunch, Stanford, CA, April 20, 2006.
UC Berkeley CS Department, Berkeley, CA, April 19, 2006.

Machine Learning for Computer Graphics
Canadian Institute for Advanced Research NCAP Summer School 2005. Toronto, ON. July 16, 2005.
Rensselaer Joint ECSE/CS Colloquium. Troy, NY. Februrary 21, 2003.

Introduction to Bayesian Learning
New York University, New York, NY. July, 2004.

Shape and Materials by Example: A Photometric Stereo Approach
CVPR 2003. Madison, WI. June 19, 2003.
NYU Computer Science Vision Talk. New York, NY. May 11, 2003.

Curve Analogies
SIGGRAPH 2002 Technical Sketch. San Antonio, Texas. July 24, 2002.
EGWR 2002. Pisa, Italy. June 28, 2002.

Fast Paint Texture
NPAR 2002. Annecy, France. June 4, 2002.

Image Analogies
NIPS 2001 Workshop on Machine Learning Methods for Images and Text. Whistler/Blackcomb Resort, BC. December 8, 2001.
SIGGRAPH 2001. Los Angeles, CA. August 16, 2001.
Microsoft Research. Redmond, WA. August 8, 2001.

Algorithms for Rendering in Artistic Styles
Zhejiang University. Hangzhou, China. September 11, 2001.
Microsoft Research. Beijing, China. August 29, 2001.
Microsoft Research. Redmond, WA. June 11, 2001.
University of Pennsylvania. Philadelpha, PA. April 19, 2001.
University of California at San Diego. La Jolla, CA. April 11, 2001.
Massachussetts Institute of Technology EECS Dept. Cambridge, MA. April 5, 2001.
University of Wisconsin at Madison. Madison, WI. April 2, 2001.
University of Illinois at Urbana-Champaign CS Department. Urbana, IL. March 26, 2001.
Georgia Institute of Technology College of Computing. Atlanta, GA. March 15, 2001.
University of Michigan EECS Department. Ann Arbor, MI. March 12, 2001.
Johns Hopkins University CS Department. Baltimore, MD. March 9, 2001.
Carnegie Mellon University SCS. Pittsburgh, PA. March 5, 2001.
University of Toronto CS Department. Toronto, ON. February 28, 2001.
Columbia University CS Department. New York, NY. Feburary 26, 2001.
Purdue Univeristy CSE Department. West Lafayette, IN. February 22, 2001.
Northwestern University CS Departmnent. Evanston, IL. Feburary 20, 2001.
University of British Columbia CS Department. Vancouver, BC. February 15, 2001.

Paint by Relaxation
Computer Graphics International. Hong Kong, China. July 4, 2001.

Style Machines
Harvard CS Departmental Colloquium. Cambridge, MA. November 20, 2000.
NYU CS Student Seminar. New York, NY. October 16, 2000.
Princeton Graphics and Geometry Lunch. Princeton, NJ. October 2, 2000.
SIGGRAPH 2000. New Orleans, LA.
Microsoft Research. Redmond, WA. May 23, 2000.

Illustrating smooth surfaces
Microsoft NetDocs Media group. Redmond, WA. August 10, 2000.
SIGGRAPH 2000. New Orleans, LA.

Painterly Rendering for Video and Interaction.
First International Symposium on Non-Photorealistic Rendering. June 5-7, 2000. Annecy, France.

Styles for Painting, Illustration, and Character Animation.
Graphics Cafe, Stanford Computer Science Department. Stanford, CA. March 2, 2000.
Rice University Computer Science Department, Houston, TX. Nov 29, 1999.
IMPA Visgraf, Rio de Janeiro, Brazil, March 17, 1999.

Tutorial on Painterly Rendering
Walt Disney Feature Animation. Burbank, CA. July 14, 1999.

Painterly Rendering with Curved Brush Strokes of Multiple Sizes
NYU CS Student Seminar, Fall 1998
SIGGRAPH, July 1998
Interval Research Corporation, June 1998

GRACE - Graphical Ruler and Compass Editor.
Fifth SIAM Conference on Geometric Design. Nashville, Nov. 1997


Press Coverage

"Walk like a human." New Scientist. 7 August 2010. p. 18-19.

"Prototype: Auto Animator." Technology Review. November 2004.

"U of T pixel-Picasso makes MIT top 100." The Varsity (student newspaper). September 23, 2004. page 1.

"Canadian researchers at top of class". The Globe and Mail. September 20, 2004. page A1.

"Rendu Non-Photoréaliste: Au Point". Pixel. Juin-Juillet 2004, 91H. pages 42-43.

"Paint by Pixel". Science News Online. Feb 14, 2004.

"Thanks to 'Professor Picasso' techniques of master artists just a click away," by Rob Harril. University of Washington University Week. February 14, 2002. page 5.

"Prototype: Virtual Virtuosity," by Nick Montfort. Technology Review. November, 2001. page 20.

"So you're no oil painting. This software could change all that", by Charles Arthur. The Independent. August 29, 2001.

"Stroke of genius as computer learns to paint a new picture," by Eddie Cassidy. Irish Examiner. August 29, 2001.

"Fine art is easy," by David Smith. Daily Express. August 28, 2001.

"Vincent gets snappy," by Catherine Zandonella. New Scientist. August 25, 2001. page 21.

"Computer mimics great masters' style". BBC News. August 23, 2001.

"Brown Outing", by Reema Jana. Artforum. April 2001. page 43.

"A Matter of Style," by Diana Mahoney. Computer Graphics World. August 2000. page 20.

"The Tech Beat," by Adam Balkin. NY1 News. Broadcast on Feburary 1, 2000.

"Morning Satellite," TV-Tokyo. Broadcast on Sep 17, 1999.

Slashdot threads: Image Analogies, Style IK