c'est moi
Ryan Schmidt
rms@dgp.toronto.edu / @rms80
Dynamic Graphics Project
Department of Computer Science
University of Toronto, Canada


PhD Computer Science, 2011

PhD Advisor: Karan Singh
MSc Advisor: Brian Wyvill
I recently left the Design & Fabrication Group at Autodesk Research to start Gradientspace! Or check out my personal site, rms80.com
publications
unpublished
software

graphics links
talks
media
service
credits
teaching
unknownroad
shapeshop
meshmixer

flickr
Phone: (email)
Fax: (email)
Mail: Autodesk Research
210 King Street East
Suite 500
Toronto, Ontario M5A 1J7

Research

My current research focuses on algorithms and interfaces that can help make 3D modeling interfaces more efficient and expressive. Towards that end, I have worked on procedural mesh representations, implicit surfaces, point-set parameterization, pen-and-ink NPR rendering, 3D widgets, and sketch-based interaction. I am also interested in rendering, computational fluid dynamics, virtual surgery, pen-based interaction, and machine learning applications in graphical interfaces. In past lives I designed tiled-projector display walls, worked as a professional developer, engineered software, and was a security/networking/systems nerd.

Check out the links below to find out more about some of the projects I have worked on.
Recent Publications
A Series of Tubes: Adding Interactivity to 3D Prints Using Internal Pipes
Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice & Björn Hartmann.
Proc. UIST 2014.
[PDF] [Video] [Details]
Pteromys: Interactive Design and Optimization of Free-formed Free-flight Model Airplanes
Nobuyuki Umetani, Yuki Koyama, Ryan Schdmit, Takeo Igarashi.
ACM Transactions on Graphics (SIGGRAPH 2014), 33(4), Article 65.
[PDF] [Video] [Details]
Branching Support Structures for 3D Printing
Ryan Schmidt, Nobuyuki Umetani.
ACM SIGGRAPH 2014 - Talks Program.
[PDF] [Slides]
  (Click here to jump down to the rest of my publications)
Projects
The goal of the 3D PrintAbility project is to devise a method to efficiently design and 3D-print prosthetic sockets for children in the developing world, based on low-cost consumer-level scanning and printing technologies. This poject is a collaboration between the Semaphore Lab at the University of Toronto, CBM Canada, CoRSU Hospital in Uganda, and Autodesk Research.
Autodesk meshmixer is a tool for working with unstructured polygonal meshes. The current version, meshmixer 2.0, includes tools for mesh cleanup, composition, sculpting, and traditional modeling tools like extrusions and booleans. Some parts of meshmixer are derived from my PhD work, see the Software section for code.
ShapeShop is a free sketch-based 3D modeling tool which incorporates much of my recent work in sketch-based modeling techniques, interactive hierarchical implicit surface modeling, implicit sweep surfaces, decal-based interactive surface-texture compositing, surface trees, sketch-based widgets. ShapeShop is definitely beta software, but you can download the latest stable version and try it out. (ShapeShop development is currently on hiatus)

Project Dasher integrates 3D Buiding Information Models (BIMs) with visualizations of real-time and historical sensor network data (light levels, temperature, cubicle electricity usage, etc). I worked on Dasher with Autodesk Research, designing and implementing the core 3D and interaction architecture, as well as shaders, precomputed ambient occlusion, shadow mapping, and 3D widgets. (Dasher is under active development, but I am no longer involved)

MAD Boxes are modular, stackable video cubes which can be used to quickly construct a wide range of different large-display scenarios. The goal of MAD Boxes is to make using a large display as simple as "Plug-and-Play". I designed the MAD box system for the Interactions Lab at the University of Calgary.
SpinalTap was my CPSC 502 course project at the University of Calgary. The initial project goal was to create an entire virtual spinal surgery simulation system. That wasn't entirely feasible for an 8-month course, so I scaled it back to just a real-time architecture for spinal drilling simulation. I revisted the project during a grad-school course and validated my simulator using real-world data (but that part isn't available yet...).
Morphidae Inlumino was my final project for CPSC 553, a fourth-year computer graphics class at the University of Calgary. I wrote a simple triangle mesh editor, modified butterfly subdivider, and a radiosity rendering engine. The radiosity renderer even used the GPU, although this was long before GPUs were programmable. Got some neat pictures, too.
Keroscene was a raytracer I wrote for CPSC 453, the third-year computer graphics class at the University of Calgary. There are some of my final raytraced images here, as well as screen-shots from some of the smaller programs I wrote for that class.

 

Publications

2014
A Series of Tubes: Adding Interactivity to 3D Prints Using Internal Pipes
Valkyrie Savage, Ryan Schmidt, Tovi Grossman, George Fitzmaurice & Björn Hartmann.
Proc. UIST 2014.
[PDF] [Video] [Details]
Automatic Balancing of 3D Models
Asger Nyman Christiansen, Ryan Schmidt, Jakob Andreas Bærentzen
Computer-Aided Design, 58, pp. 236–241. (SPM 2014 Special Issue) (To Appear)
[PDF] [Details] [DL] [ScienceDirect PDF]
Pteromys: Interactive Design and Optimization of Free-formed Free-flight Model Airplanes
Nobuyuki Umetani, Yuki Koyama, Ryan Schdmit, Takeo Igarashi.
ACM Transactions on Graphics (SIGGRAPH 2014), 33(4), Article 65.
[PDF] [Video] [Details]
Branching Support Structures for 3D Printing
Ryan Schmidt, Nobuyuki Umetani.
ACM SIGGRAPH 2014 - Talks Program.
[PDF] [Slides]
Position-Based Elastic Rods
Nobuyuki Umetani, Ryan Schmidt & Jos Stam.
Proc. SCA 2014 (Also SIGGRAPH 2014 Talk - details)
[PDF] [Video] [Details]

History Assisted View Authoring for 3D Models
Hsiang-Ting (Tim) Chen, Tovi Grossman, Ryan Schmidt, Björn Hartmann, George Fitzmaurice & Maneesh Agrawala.
Proc. ACM CHI 2014.
[PDF] [Video] [Details]

2013
Stroke Parameterization (2013)
Ryan Schmidt.
Computer Graphics Forum 32(2). (Proc. Eurographics 2013) (To Appear)
[PDF] [Video] [Details]
Cross-sectional Structural Analysis for 3D Printing Optimization (2013)
Nobuyuki Umetani, Ryan Schmidt.
ACM SIGGRAPH ASIA 2013 - Technical Briefs Program.
[PDF] [Video] [Details]
Design-to-Fabricate: Maker Hardware Requires Maker Software (2013)
Ryan Schmidt, Matt Ratto.
IEEE Computer Graphics & Applications. December 2013, Volume 33. Issue 6, pp. 26-34
[PDF] [IEEE DL]
Design Tools for the Rest of Us: Maker Hardware Requires Maker Software (2013)
Ryan Schmidt, Matt Ratto.
FAB @ CHI Workshop, CHI 2013
[PDF]
2012
Interactive Modeling With Mesh Surfaces (2012).
Ryan Schmidt
ACM SIGGRAPH 2012 - Studio Talks Program
[PDF] [Images] [Video] [Slides] [Project] [Program]
Consensus Meshing (2012).
Ryan Schmidt, Patricio Simari
Proc. SMI 2012 (To Appear)
[PDF] [Slides] [Details]
2011
On the Velocity of an Implicit Surface (2011).
Jos Stam, Ryan Schmidt
ACM Transactions on Graphics, 30(3), Article 21.
[PDF] [Video] [Details]
GeoBrush: Interactive Mesh Geometry Cloning (2010).
Kenshi Takayama, Ryan Schmidt, Karan SinghTakeo IgarashiTamy BoubekeurOlga Sorkine.
Computer Graphics Forum, 30, pp. 613-622. (Proc. Eurographics 2011)
[PDF] [Video] [Details, Slides, Demo, Source Code]
2010
Part-Based Representation and Editing of 3D Surface Models (2010).
Ryan Schmidt.
PhD Thesis, University of Toronto
[PDF] [URI] [Details]
meshmixer: an interface for rapid mesh composition (2010).
Ryan Schmidt, Karan Singh.
ACM SIGGRAPH 2010 - Talks Program
[PDF] [Video] [Project] [Program] [ACM DL]
WarpCurves: A Tool for Explicit Manipulation of Implicit Surfaces (2010).
Masamichi Sugihara, Brian Wyvill, Ryan Schmidt.
Shape Modeling International (SMI) 2010.
(SMI 2010 Best Paper Award)
[PDF] [Video] [Project]
2009
Analytic Drawing of 3D Scaffolds (2009)
Ryan Schmidt, Azam Khan, Karan Singh, Gord Kurtenbach.
ACM Transactions on Graphics (SIGGRAPH ASIA 2009), 28(5), Article 149.
[PDF] [Slides] [Video] [Details]
Dog Image
On Expert Performance in 3D Curve-Drawing Tasks (2009)
Ryan Schmidt, Azam Khan, Gord Kurtenbach, Karan Singh.
Eurographics Symposium on Sketch-Based Interfaces and Modeling (SBIM) 2009.
[PDF] [Slides] [Details]
ShapeShop: Free-Form 3D Design with Implicit Solid Modeling (2009)
Ryan Schmidt, Brian Wyvill.
Chapter in Sketch-Based Interfaces and Modeling (J. Jorge and F. Samavati, eds) (To Appear).
[PDF]
2008
Dog Image
Sketch-Based Procedural Surface Modeling and Compositing with Surface Trees (2008)
Ryan Schmidt, Karan Singh.
Computer Graphics Forum, 27(2), pp. 321-330. (Proceedings of Eurographics 2008).
[PDF] [Video] [Details]
Dog Image
Sketching and Composing Widgets for 3D Manipulation (2008)
Ryan Schmidt, Karan Singh, Ravin Balakrishnan.
Computer Graphics Forum, 27(2), pp. 301-310. (Proceedings of Eurographics 2008).
[PDF] [Video] [Details]
A Sketch-Based Method to Control Deformation in a Skeletal Implicit Surface Modeler (2008).
Masamichi Sugihara, Erwin de Groot, Brian Wyvill, Ryan Schmidt.
5th Eurographics Workshop on Sketch-Based Interfaces and Modeling. [PDF] [Project]
2007
Dog Image Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling (2007)
Ryan Schmidt, Tobias Isenberg, Pauline Jepp, Karan Singh, Brian Wyvill.
Proceedings of NPAR 2007, pp. 23-32.
[PDF] [PDF Slides] [Details]
2006
Interactive Decal Compositing with Discrete Exponential Maps (2006).
Ryan Schmidt, Cindy Grimm, Brian Wyvill.
ACM Transactions on Graphics (SIGGRAPH 2006), 25(3), July 2006, pp. 605-613.
[PDF] [Video] [Figures] [Project] [Tech Report] [Demo+Source]
Interactive Modeling with Implicit Surfaces (2006).
Ryan Schmidt.
MSc Thesis, Department of Computer Science, University of Calgary.
[PDF]
Interactive Pen-and-Ink Rendering for Implicit Surfaces (2006).
Ryan Schmidt, Tobias Isenberg, Brian Wyvill.
ACM SIGGRAPH 2006, Technical Sketch.
[PDF] [Video] [Project]
The GPU Cluster without the Clutter: A Drop-in Scalable Programmable-Pipeline with Several GPUs and Only One PC (2006)
Eric Penner, Ryan Schmidt, Sheelagh Carpendale.
ACM I3D 2006, Technical Poster. [PDF]
2005
ShapeShop: Sketch-Based Solid Modeling with BlobTrees (2005)
Ryan Schmidt, Brian Wyvill, Mario Costa Sousa, Joaquim A. Jorge.
2nd Eurographics Workshop on Sketch-Based Interfaces and Modeling, pp. 53-62.
[PDF] [Figures] [PDF Slides] [Powerpoint Slides w/ Videos] [Project]
Sketch Based Construction and Rendering of Implicit Models (2005).
Brian Wyvill, Kevin Foster, Pauline Jepp, Ryan Schmidt, Mario Costa Sousa, Joaquim A. Jorge.
1st EG Workshop on Computational Aesthetics in Graphics, Visualization and Imaging. [PDF]
Sketch-Based Modeling with the BlobTree (2005).
Ryan Schmidt, Brian Wyvill, Mario Costa Sousa.
ACM SIGGRAPH 2005, Technical Sketch.
[PDF] [Figures] [Video] [PDF Slides] [Project]
Generalized Sweep Templates for Implicit Modeling (2005).
Ryan Schmidt, Brian Wyvill.
Proeedings of GRAPHITE 2005, pp. 187-196.
[PDF]
Interactive Implicit Modeling with Hierarchical Spatial Caching (2005).
Ryan Schmidt, Brian Wyvill, Eric Galin.
Proceedings of Shape Modeling International 2005, pp. 104 - 113.
[PDF] [PDF Slides] [Tech Report ]
2004
Reconfigurable Displays (2004)
Ryan Schmidt, Eric Penner, Sheelagh Carpendale.
Workshop on Ubiquitous Display Environments at Ubiquitous Computing (UBICOMP) 2004.
[PDF] [Project]
Patents

Techniques for Authoring View Points, View Paths, and View Surfaces for 3D Models. Hsiang-Ting Chen, Tovi Grossman, Wei LI-YI, Ryan Michael SCHMIDT, Bjoern HARTMANN, George Fitzmaurice, Maneesh Agrawala (Filed 2014) [Details]
Techniques for optimizing orientation of models for three-dimensional printing. Ryan Schmidt, Nobuyuki Umetani (Filed 2014) [Details]
Techniques for performing cross-sectional stress analysis for three-dimensional objects. Nobuyuki Umetani, Ryan Schmidt (Filed 2014) [Details]
Generating Support Material for Three-Dimensional Printing. Ryan Schmidt (Filed 2014) [Details]
Evaluating the stability of three-dimensional models. Ryan Schmidt (Filed 2013) [Details]
Photograph localization in a three-dimensional model. Ryan Schmidt, Ramtin ATTAR, Azam Khan (Filed 2013) [Details]
Generating informative viewpoints based on editing history. Hsiang-Ting Chen, Tovi Grossman, Wei LI-YI, Ryan Michael SCHMIDT, Bjoern HARTMANN, George Fitzmaurice, Maneesh Agrawala (Filed 2013) [Details]
Technique for filling holes in a three-dimensional model. Ryan Schmidt (Filed 2013) [Details]
Technique for mapping a texture onto a three-dimensional model
. Ryan Schmidt (Filed 2013) [Details]
Interactive tool for inspecting and repairing three dimensional models. Ryan Schmidt (Filed 2013) [Details]
Generating a Consensus Mesh from an input set of Meshes. Ryan Schmidt, Patricio Simari (Filed 2013) [Details]
Adaptive mesh refinement. Ryan Schmidt (Filed 2013) [Details]
Mesh boundary smoothing. Ryan Schmidt (Filed 2013) [Details]
Adaptively joining meshes. Ryan Schmidt (Filed 2013) [Details]
Adaptively merging intersecting meshes. Ryan Schmidt (Filed 2013) [Details]
Adaptively zippering meshes. Ryan Schmidt (Filed 2013) [Details]
Volume-preserving smoothing brush. Ryan Schmidt. (Filed 2012) [Details]
Resolution-adaptive mesh smoothing brush. Ryan Schmidt. (Filed 2012) [Details]
Systems and methods for manipulating a 3d object in a 3d model using a software widget and surface constraints. Ryan Schmidt. (Filed 2012) [Details]
Navigation System for 3D Virtual Scene. George Fitzmaurice, Justin Matejka, Igor Mordatch, Ryan Schmidt. (Filed 2008, Granted 2012) [Details]
Three-Dimensional Orientation Indicator and Controller. Anirban Ghosh, Igor Mordatch, Azam Khan, George Fitzmaurice, Justin Matejka, Ryan Schmidt, Gord Kurtenbach. (Filed 2007, Granted 2010). [Details]

 

Unpublished Works

2010

Drag, Drop, and Clone: An Interactive Interface for Surface Composition (2010).
Ryan Schmidt, Karan Singh.
Technical Report CSRG-611, Department of Computer Science, University of Toronto
[PDF] [Video] [Software]

2009
Drag-and-Drop Surface Composition (2009)
Ryan Schmidt, Karan Singh
Technical Report CSRG-604, Department of Computer Science, University of Toronto
[PDF] [Video] [Software]
Approximate Conformal Parameterization of Point-Sampled Surfaces (2009)
Ryan Schmidt, Karan Singh
Technical Report CSRG-605, Department of Computer Science, University of Toronto
[PDF]
2007
Dog Image
Surface Trees: Interactive Hierarchical Surface Modeling (2007)
Ryan Schmidt, Karan Singh.
[PDF] [Video]
2005
Implicit Sweep Surfaces (2005).
Ryan Schmidt, Brian Wyvill.
Technical Report 2005-778-09, Department of Computer Science, University of Calgary.
[PDF]
MAD Boxes: A Plug-And-Play Tiled Display Wall (2005)
Ryan Schmidt, Eric Penner, Sheelagh Carpendale.
Technical Report TR-2004-768-33, Department of Computer Science, University of Calgary.
[PDF] [Project]
2002-2004
SpinalTap: An Architecture for Real-Time Vertebrae Drilling Simulation (2002).
Ryan Schmidt.
Technical Report 2002-705-08, Department of Computer Science, University of Calgary.
[PDF] [Project]

 

Software

2D/3D Design & Modeling
  ShapeShop - A Sketch-Based 3D Modeling Tool
  Mesh Drag-and-Drop Demo (C++ source only)
  Mesh Clone Brush Demo (C++ source only)
  Mesh Segmetation Tool (C++ source only)
  libgeometry: a discrete shape modeling library (C++ source only)
  Pencil: A Simple Sketchbook (C# source only)
  As-Rigid-As-Possible 2D Shape Manipulation Demo (binary & C# source)
  2D Laplacian Curve Deformation Demo (C# source)
  Implicit Surface Mesher (C++ source only)
  2D Blobs Demo (C# source only)
Surface Parameterization
  Discrete Exponential Map Demo (binary & C++ source)
Geometry Processing
  Matlab Mesh Toolkit (matlab source)
Miscellany
  Sketch UI Framework (source-ish)
  Shapeways.com API wrapper (source)
  Generic Solver Interface (GSI) (C++source)

 

Media

Interviews
  3D Printing's future is the high street, not the home (October 2, 2014)
  Can an Armadillo paper airplane fly? Autodesk says yes (CNET) (August 9, 2014)
  3D Printing Low-Cost Prosthetic Parts in Uganda (medGadget) (March 7, 2014)
  3D Printing Prosthetic Limbs in Uganda (BBC World Service / BBC Click) (April 30, 2014)
  Fabricated Future: the sceptic's guide to 3D printing (New Scientist) (December 19, 2012)
Panels
  3D Manufacturing: Beyond the Hype (OCE Discovery 2014, Toronto)
Online Articles
  How the weirdest designs can become great paper airplanes (New Scientist) (August 8, 2014)
  Autodesk acquires MeshMixer (cgchannel.com) (October 31st, 2011)

 

Talks

Conference / Workshop Presentations
  SIAM GD/SPM 2015 (Designing for AM: Integrating Mesh-Based Modeling Techniques with Parametric Cad)
  RAPID 2015 (Branching Support Structures for 3D Printing)
  SIGGRAPH 2015 (3D-Printed Prosthetics for the Developing World)
  GI 2015 (The Evolution of CAD: New Tools for our 3D-Printed Future)
  SIGGRAPH 2014 (Branching Support Structures for 3D Printing)
  Eurographics 2013 (Stroke Parameterization)
  SIGGRAPH 2012 (Interactive Modeling with Mesh Surfaces)
  SIGGRAPH 2010 (meshmixer: an interface for rapid mesh composition)
  SIGGRAPH Asia 2009 (Analytic Drawing of 3D Scaffolds)
  SBIM 2009 (On Expert Performance in 3D Curve-Drawing Tasks)
  Eurographics 2008 (Sketching and Composing Widgets for 3D Manipulation)
  Eurographics 2008 (Sketch-Based Procedural Surface Modeling and Compositing with Surface Trees)
  NPAR 2007 (Sketching, Scaffolding, and Inking: A Visual History for Interactive 3D Modeling)
  ACM SIGGRAPH 2006 (Interactive Decal Compositing with Discrete Exponential Maps)
  Sketch-Based Modeling Workshop 2005 (ShapeShop: Sketch-Based Solid Modeling with BlobTrees)
  ACM SIGGRAPH Sketches 2005 (Sketch-Based Modeling with the BlobTree)
  Shape Modeling International 2005 (Interactive Implicit Modeling with Hierarchical Spatial Caching)
  Workshop on Ubiquitous Display Environments @ UBICOMP 2004 (Reconfigurable Displays)
Other Talks
  Computation Lecture Series, MIT School of Architecture - Computer-Aided Perspective Drawing (Mar 2013)
  Applied Geometry Lab @ Caltech - Applied Geometry Processing in Meshmixer (Aug 2012)
  Autodesk Tech Summit - meshmixer: Interactive Surface Modeling with Dynamic Triangle Meshes (June 2012)
  Autodesk Tech Summit - Repairing 3D Scan Meshes with meshmixer (June 2012)
  Adobe CTL - Analytic Drawing and Perception of Line Drawings (Feb 2011)
  UCBerkeley - Analytic Drawing and Expert Drawing Performance (May 2010)
  JST/ERATO Design UI Project - Analytic Drawing (December 2009)
  University of Victoria - Drawing Perception, Analytic Drawing (November 2009)
  Autodesk - Analytic Drawing (Summer 2009)
Demos
  DCS Research In Action - Analytic Drawing Demo (November 2009)
  UIST 2009 - Analytic Drawing Demo (November 2009)
  DGPis40 Workshop - ShapeShop Demo (May 2008)
  TTI/Vanguard - ShapeShop Demo (April 2008)
  DCS Research In Action - ShapeShop Demo (February 2008)
  DemoCamp16 - ShapeShop Demo (November 2007)
  Undergraduate Open House - DGP Graphics Overview (November 2007)
  Fall Campus Day - DGP Tours & Demos (October 2007)
  Google "Gr8 Designs for Gr8 Girls" - ShapeShop Demo (May 2007)
  Undergraduate Recruitment Day - DGP Graphics Overview (March 2006)

 

Service

Program Committees:
  Eurographics Technical Papers (2011, 2015, 2016)
  ACM SIGGRAPH General Submissions (2012-2013)
  ACM SIGGRAPH Student Research Competition (2012, 2013)
  Sketch-Based Interaction and Modeling (2012)
Technical Paper Reviewer:
  ACM SIGGRAPH (2008-2015)
  ACM SIGGRAPH ASIA (2009-2015)
  ACM Transactions on Graphics (2008,2009)
  Eurographics (2008-2012)
  ACM UIST (2010-2014)
  ACM CHI (2011-2014)
  Computers & Graphics (2008,2009)
  IEEE Virtual Reality (2008)
  IEEE Computer Graphics & Applications (2005-2011)
  IEEE Transactions on Visualization and Computer Graphics (2006,2009)
  IEEE 3DUI (2009)
  Graphics Interface (2006,2009,2012)
  Pacific Graphics (2012)
  ACM SIGGRAPH Posters (2006)

 

Credits

Images
  ACM Transactions on Graphics 25(5) / SIGGRAPH Asia 2009 Proceedings (back cover)
  SBIM 2009 Proceedings (back cover)
  SBIM 2005 Proceedings (front cover)
Film
  The Spine (2009) - Additional R&D Programming

 

Teaching

Instruction
  Lassonde Technology Faire 3D Printing Workshop (April 2014, York University)
  SIGGRAPH Toronto Chapter 3D Printing Workshop (March 2014, Toronto)
  Ladies Learning Code 3D Printing Workshop (July 2012, TIFF Bell Lightbox)
Teaching Assistant
  CSC320 - Intro To Visual Computing (Winter 2009, University of Toronto)
  CSC491 - Capstone Design Couse (Fall 2007, University of Toronto)
  CSC418/2504 - Intro to Computer Graphics (Fall 2007, Winter 2008, University of Toronto)
  CPSC231 - Intro to Computer Science I (Fall 2002, University of Calgary)
  CPSC355 - Computer Architecture and Low-Level Programming (Fall 2002, University of Calgary)
Web Tutorials
  GDB (GNU debugger) Tutorial
  Java Swing Tutorial
  OpenGL Selection Buffer Tutorial
  Raytracing Tutorials - Eye Rays, Transforming Normals