Bryan Wang, Ph.D.Bryan Wang, Ph.D.

Bryan Wang, Ph.D.

Research Scientist
Adobe Research

CV available upon request

I am a Research Scientist at Adobe Research.

My research centers on human-AI interaction, with a focus on creating interactive AI systems that empower and inspire creative expression in video and audio. Recent highlights include research on video editing agents, UI agents, and LLM-assisted image generation.

I received my Ph.D. and M.Sc. in Computer Science from the University of Toronto and my B.Sc. in Computer Science from National Taiwan University.

Publications

*I primarily publish system HCI work at top-tier venues (CHI, UIST, IUI), with two papers among the top 6 highest cited UIST papers published in the past 5 years.

Filter by venue:

KnowledgeTrail: Generative Timeline for Exploration and Sensemaking of Historical Events and Knowledge Formation

arXiv 2025

KnowledgeTrail: Generative Timeline for Exploration and Sensemaking of Historical Events and Knowledge Formation

Sangho Suh, Rahul Hingorani, Bryan Wang, Tovi Grossman

Script2Screen: Supporting Dialogue Scriptwriting with Interactive Audiovisual Generation

arXiv 2025

Script2Screen: Supporting Dialogue Scriptwriting with Interactive Audiovisual Generation

Zhecheng Wang, Jiaju Ma, Eitan Grinspun, Tovi Grossman, Bryan Wang

MapStory: Prototyping Editable Map Animations with LLM Agents

UIST 2025

MapStory: Prototyping Editable Map Animations with LLM Agents

Aditya Gunturu, Ben Pearman, Keiichi Ihara, Morteza Faraji, Bryan Wang, Rubaiat Habib Kazi, Ryo Suzuki

SimTube: Generating Simulated Video Comments through Multimodal AI and User Personas

IUI 2025

SimTube: Generating Simulated Video Comments through Multimodal AI and User Personas

Yu-Kai Hung, Yun-Chien Huang, Ting-Yu Su, Yen-Ting Lin, Lung-Pan Cheng, Bryan Wang*, Shao-Hua Sun* (∗Equal advisory contribution.)

GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions

CHI 2025

GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions

Hsin-Ruey Tsai, Shih-Kang Chiu, Bryan Wang

Human-AI Systems for Creating, Consuming, and Interacting with Digital Content

Thesis 2025

Human-AI Systems for Creating, Consuming, and Interacting with Digital Content

Bryan Wang

LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing

IUI 2024

LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing

Bryan Wang, Yuliang Li, Zhaoyang Lv, Haijun Xia, Yan Xu, Raj Sodhi

SynthScribe: Deep Multimodal Tools for Synthesizer Sound Retrieval and Exploration

IUI 2024

Jazzki Human-Machine Creativity Award, First Place

SynthScribe: Deep Multimodal Tools for Synthesizer Sound Retrieval and Exploration

Stephen Brade, Bryan Wang, Mauricio Sousa, Gregory Lee Newsome, Sageev Oore, Tovi Grossman

Flowy: Supporting UX Design Decisions Through AI-Driven Pattern Annotation in Multi-Screen User Flows

arXiv 2024

Flowy: Supporting UX Design Decisions Through AI-Driven Pattern Annotation in Multi-Screen User Flows

Yuwen Lu, Ziang Tong, Qinyi Zhao, Yewon Oh, Bryan Wang, Toby Jia-Jun Li

A Zero-Shot Language Agent for Computer Control with Structured Reflection

EMNLP 2023

A Zero-Shot Language Agent for Computer Control with Structured Reflection

Tao Li, Gang Li, Zhiwei Deng, Bryan Wang, Yang Li

Democratizing Content Creation and Consumption through Human-AI Copilot Systems

UIST 2023

Democratizing Content Creation and Consumption through Human-AI Copilot Systems

Bryan Wang

Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models

UIST 2023

Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models

Stephen Brade, Bryan Wang, Mauricio Sousa, Sageev Oore, Tovi Grossman

Enabling Conversational Interaction with Mobile UI using Large Language Models

CHI 2023

Enabling Conversational Interaction with Mobile UI using Large Language Models

Bryan Wang, Gang Li, Yang Li

Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues

CHI 2023

Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues

Jiannan Li, Mauricio Sousa, Bryan Wang, Paula Akemi Aoyagui, Nicole Yu, Angela Yang, Ravin Balakrishnan, Anthony Tang, Tovi Grossman

Creepy Assistant: Development and Validation of a Scale to Measure the Perceived Creepiness of Voice Assistants

CHI 2023

Creepy Assistant: Development and Validation of a Scale to Measure the Perceived Creepiness of Voice Assistants

Rachel Phinnemore, Mohi Reza, Blaine Lewis, Karthik Mahadevan, Bryan Wang, Michelle Annett, Daniel Wigdor

Record Once, Post Everywhere: Automatic Shortening of Audio Stories for Social Media

UIST 2022

Record Once, Post Everywhere: Automatic Shortening of Audio Stories for Social Media

Bryan Wang, Zeyu Jin, Gautham Mysore

Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning

UIST 2021

Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning

Bryan Wang, Gang Li, Xin Zhou, Zhourong Chen, Tovi Grossman, Yang Li

Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing

CHI 2021

Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing

Bryan Wang, Meng Yu Yang, Tovi Grossman

AIive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

AIVR 2021

Best Presentation Award

AIive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

Zhuoyue Lyu, Jiannan Li, Bryan Wang

BlyncSync: Enabling Multimodal Smartwatch Gestures with Synchronous Touch and Blink

CHI 2020

BlyncSync: Enabling Multimodal Smartwatch Gestures with Synchronous Touch and Blink

Bryan Wang, Tovi Grossman

PerformanceNet: Score-to-Audio Music Generation with Multi-Band Convolutional Residual Network

AAAI 2019

PerformanceNet: Score-to-Audio Music Generation with Multi-Band Convolutional Residual Network

Bryan Wang, Yi-Hsuan Yang

Demonstration of PerformanceNet: A Convolutional Neural Network Model for Score-to-Audio Music Generation

IJCAI 2019

Demonstration of PerformanceNet: A Convolutional Neural Network Model for Score-to-Audio Music Generation

Yu-Hua Chen, Bryan Wang, Yi-Hsuan Yang

ActiveErgo: Automatic and Personalized Ergonomics Using Self-Actuating Furniture

CHI 2018

ActiveErgo: Automatic and Personalized Ergonomics Using Self-Actuating Furniture

Yu-Chian Wu, Te-Yen Wu, Paul Taele, Bryan Wang, Jun-You Liu, Pin-Sung Ku, Po-En Lai, Mike Y. Chen

CircuitSense: Automatic Sensing of Physical Circuits and Generation of Virtual Circuits to Support Software Tools

UIST 2017

CircuitSense: Automatic Sensing of Physical Circuits and Generation of Virtual Circuits to Support Software Tools

Te-Yen Wu, Bryan Wang, Jiun-Yu Lee, Hao-Ping Shen, Yu-Chian Wu, Yu-An Chen, Pin-Sung Ku, Ming-Wei Hsu, Yu-Chih Lin, Mike Y. Chen

CircuitStack: Supporting Rapid Prototyping and Evolution of Electronic Circuits

UIST 2016

Best Talk Award

CircuitStack: Supporting Rapid Prototyping and Evolution of Electronic Circuits

Chiuan Wang, Hsuan-Ming Yeh, Bryan Wang, Te-Yen Wu, Hsin-Ruey Tsai, Rong-Hao Liang, Yi-Ping Hung, Mike Y. Chen

Experience

Summer 2023

Research Intern Meta Reality Labs - Research

Host(s): Raj Sodhi

Developed LAVE, a video editing tool with LLM-powered agent assistance. Published at IUI 2024.

Summer 2022

Student Researcher Google Research

Host(s): Yang Li and Gang Li

Designed prompting techniques for conversational mobile UI interaction using LLMs. Published at CHI 2023.

Summer 2021, Winter 2022

Research Intern Adobe Research

Host(s): Gautham J. Mysore and Zeyu Jin

Developed ROPE, an audio story editing tool for automatically shortening voice recordings using NLP. Published at UIST 2022

Summer 2020, Winter 2021

Research Intern Google Research

Host(s): Yang Li and Gang Li

Created large-scale UI-language dataset (110k+ summaries, 22k+ UIs) and trained multimodal networks for screen summarization. Published at UIST 2021.

Press

Academic Services

Program Committee

ACM UIST
'23, '24, '25

Program Committee

ACM CHI
'25, '26

Program Committee

ACM IUI
'25, '26

Program Committee

ACM DIS
'25

Organizer

ICML Workshop on AI & HCI
'23

Mentoring

Intern Supervision

Catherine Yeh
PhD Student
Harvard University
Summer 2025
Primary Mentor
Mina Huh
PhD Student
UT Austin
Summer 2025
Primary Mentor
Ruei-Che Chang
PhD Student
University of Michigan
Summer 2025
Primary Mentor
Karim Benharrak
PhD Student
UT Austin
Summer 2025
Co-Mentor

Thesis Committee Service

Noor Hammad
PhD Student
Carnegie Mellon University
2025-Present
External Committee Member
Yuwen Lu
PhD Student
University of Notre Dame
2025-Present
External Committee Member

Research Advising

Zhecheng Wang
PhD Student
University of Toronto
2024-Present
Research Mentor
Stephen Brade
MSc Student
University of Toronto
Now: PhD Student at MIT
2022-2024
Research Mentor
Rachel Phinnemore
MSc Student
University of Toronto
Now: TPM at Google
2023
Research Mentor