About
Careers
Publications
Highlights
Gen-2: The Next Step Forward for Generative AI
High-Resolution Image Synthesis with Latent Diffusion Models
Towards Unified Keyframe Propagation Models
Soundify: Matching Sound Effects to Video
Sign in to Runway
About
Highlights
Gen-2
Latent Diffusion
Interview: Origins of Stable Diffusion
Towards Unified Keyframe Propagation Models
Soundify
Reimagining creativity with artificial intelligence
Research - Video Generation
Gen-2: The Next Step Forward for Generative AI
Learn More
Research - Image Synthesis
Learn about the architecture behind Stable Diffusion
High-Resolution Image Synthesis with Latent Diffusion Models
Learn More
Research Interview
The research origins of Stable Diffusion
Learn More
Highlights
Video synthesis
Gen-1: Structure and Content-Guided Video Synthesis with Diffusion Models
Patrick Esser, Jonathan Granskog, Johnathan Chiu, Parmida Atighehchian, Anastasis Germanidis
Runway
read more
Image synthesis
High-Resolution Image Synthesis with Latent Diffusion Models
Robin Rombach
1
, Andreas Blattmann
1
, Dominik Lorenz
1
, Patrick Esser
2
, Björn Ommer
1
1
IWR, Heidelberg University
,
2
Runway
read more
Computer Vision
Towards Unified Keyframe Propagation Models
Patrick Esser
1
,
Peter Michael
1, 2
,
Soumyadip Sengupta
2
1
Runway,
2
University of Washington
read more
Audio Generation
Soundify: Matching Sound Effects to Video
David Chuan-En Lin
1
,
Anastasis Germanidis
2
,
Cristóbal Valenzuela
2
,
Yining Shi
2
,
Nikolas Martelaro
1
1
Carnegie Mellon University,
2
Runway
read more
Article, Applied AI
Building a Web-based Real-time Video Editing Tool with Machine Learning
Anastasis Germanidis, Brannon Dorsey
read more
Article, ML Ops
Distributing Work: Adventures in Queuing
Brannon Dorsey
read more
CREATIVE AI CONVERSATIONS
Creative AI Conversations are a series of conversations with prominent AI researchers and artists on their perspectives on creative AI. Hosted by Lia Coleman
WE ARE READING
A curated list of research papers we are reading
Explore Careers