Bryan Wang

I am a Research Scientist at Adobe Research.

My research centers on human-AI interaction, with a focus on advancing the next generation of AI systems that empower and inspire creative expression. I design, develop, and study interactive AI systems that enhance human capabilities in creating, consuming, and interacting with digital content—particularly in video and audio.

Recent highlights include early work on video editing agents, mobile UI agents, and prompt writing with LLMs for image generation.

I received my Ph.D. and M.Sc. from the University of Toronto, where I was advised by Tovi Grossman, and my B.Sc. from National Taiwan University.

News

Publications

ACM IUI 2025

SimTube: Generating Simulated Video Comments through Multimodal AI and User Personas

Yu-Kai Hung, Yun-Chien Huang, Ting-Yu Su, Yen-Ting Lin, Lung-Pan Cheng, Bryan Wang*, Shao-Hua Sun* (∗Equal advisory contribution.)

PaperWebsite

ACM CHI 2025

GazeNoter: Co-Piloted AR Note-Taking via Gaze Selection of LLM Suggestions to Match Users' Intentions

Hsin-Ruey Tsai, Shih-Kang Chiu, Bryan Wang

Paper

ACM IUI 2024

LAVE: LLM-Powered Agent Assistance and Language Augmentation for Video Editing

Bryan Wang, Yuliang Li, Zhaoyang Lv, Haijun Xia, Yan Xu, Raj Sodhi

PaperVideoWebsite

ACM IUI 2024

Jazzki Human-Machine Creativity Award, First Place

SynthScribe: Deep Multimodal Tools for Synthesizer Sound Retrieval and Exploration

Stephen Brade, Bryan Wang, Mauricio Sousa, Gregory Lee Newsome, Sageev Oore, Tovi Grossman

PaperVideo

EMNLP, Findings Track 2023

A Zero-Shot Language Agent for Computer Control with Structured Reflection

Tao Li, Gang Li, Zhiwei Deng, Bryan Wang, Yang Li

Paper

ACM UIST, Doctoral Symposium 2023

Democratizing Content Creation and Consumption through Human-AI Copilot Systems

Bryan Wang

Paper

ACM UIST 2023

Promptify: Text-to-Image Generation through Interactive Prompt Exploration with Large Language Models

Stephen Brade, Bryan Wang, Mauricio Sousa, Sageev Oore, Tovi Grossman

PaperVideo

ACM CHI 2023

Enabling Conversational Interaction with Mobile UI using Large Language Models

Bryan Wang, Gang Li, Yang Li

PaperVideo

ACM CHI 2023

Stargazer: An Interactive Camera Robot for Capturing How-To Videos Based on Subtle Instructor Cues

Jiannan Li, Mauricio Sousa, Bryan Wang, Paula Akemi Aoyagui, Nicole Yu, Angela Yang, Ravin Balakrishnan, Anthony Tang, Tovi Grossman

PaperVideo

ACM CHI 2023

Creepy Assistant: Development and Validation of a Scale to Measure the Perceived Creepiness of Voice Assistants

Rachel Phinnemore, Mohi Reza, Blaine Lewis, Karthik Mahadevan, Bryan Wang, Michelle Annett, Daniel Wigdor

PaperVideo

ACM UIST 2022

Record Once, Post Everywhere: Automatic Shortening of Audio Stories for Social Media

Bryan Wang, Zeyu Jin, Gautham Mysore

PaperVideoWebsite

ACM UIST 2021

Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning

Bryan Wang, Gang Li, Xin Zhou, Zhourong Chen, Tovi Grossman, Yang Li

PaperVideoCodeDataset

ACM CHI 2021

Soloist: Generating Mixed-Initiative Tutorials from Existing Guitar Instructional Videos Through Audio Processing

Bryan Wang, Meng Yu Yang, Tovi Grossman

PaperVideo

IEEE AIVR 2021

Best Presentation Award

AIive: Interactive Visualization and Sonification of Neural Networks in Virtual Reality

Zhuoyue Lyu, Jiannan Li, Bryan Wang

PaperVideo

ACM CHI 2020

BlyncSync: Enabling Multimodal Smartwatch Gestures with Synchronous Touch and Blink

Bryan Wang, Tovi Grossman

PaperVideo

AAAI 2019

PerformanceNet: Score-to-Audio Music Generation with Multi-Band Convolutional Residual Network

Bryan Wang, Yi-Hsuan Yang

PaperVideoCode

IJCAI 2019

Demonstration of PerformanceNet: A Convolutional Neural Network Model for Score-to-Audio Music Generation

Yu-Hua Chen, Bryan Wang, Yi-Hsuan Yang

PaperVideo

ACM CHI 2018

ActiveErgo: Automatic and Personalized Ergonomics Using Self-Actuating Furniture

Yu-Chian Wu, Te-Yen Wu, Paul Taele, Bryan Wang, Jun-You Liu, Pin-Sung Ku, Po-En Lai, Mike Y. Chen

PaperVideo

ACM UIST 2017

CircuitSense: Automatic Sensing of Physical Circuits and Generation of Virtual Circuits to Support Software Tools

Te-Yen Wu, Bryan Wang, Jiun-Yu Lee, Hao-Ping Shen, Yu-Chian Wu, Yu-An Chen, Pin-Sung Ku, Ming-Wei Hsu, Yu-Chih Lin, Mike Y. Chen

PaperVideo

ACM UIST 2016

Best Talk Award

CircuitStack: Supporting Rapid Prototyping and Evolution of Electronic Circuits

Chiuan Wang, Hsuan-Ming Yeh, Bryan Wang, Te-Yen Wu, Hsin-Ruey Tsai, Rong-Hao Liang, Yi-Ping Hung, Mike Y. Chen

PaperVideo

Press