Video by Vallée Duhamel

Gen-1: The Next Step
Forward for Generative AI

Use words and images to generate new videos out of existing ones.
Watch the Explainer
No lights. No camera.
All action.
Realistically and consistently synthesize new videos by applying the composition and style of an image or text prompt to the structure of your source video.
Introducing a more expressive, cinematic and consistent video generation technique.
Bringing the magic
back to making movies.
Learn how Gen-1 can turn any video into a compelling piece of footage.
Mode 01: Stylization
Transfer the style of any image or prompt to every frame of your video.
Source Video
Driving Image
Generated Video
Mode 02: Storyboard
Turn mockups into fully stylized and animated renders.
Mode 03: Mask
Isolate subjects in your video and modify them with simple text prompts.
Input Video
A dog with black spots on white fur.
Driving Prompt
Output Video
Mode 04: Render
Turn untextured renders into realistic outputs by applying an input image or prompt.
Mode 05: Customization
Unleash the full power of Gen-1 by customizing the model for even higher fidelity results.
Training Images
The New Standard for Video Generation
Based on user studies, results from GEN-1 are preferred over existing methods for image-to-image and video-to-video translation.
73.53%
Preferred over Stable Diffusion 1.5
88.24%
Preferred over Text2Live
A New Era for Motion (and) Pictures
Runway Research is dedicated to building the multimodal AI systems that will enable new forms of creativity. Gen-1 represents yet another of our pivotal steps forward in this mission. If you're a creative looking to experiment with the future of storytelling, request access below.

AI systems for image and video synthesis are quickly becoming more precise, realistic and controllable. Runway Research is at the forefront of these developments and is dedicated to ensuring the future of creativity is accessible, controllable and empowering for all.

Gen-1
Structure and Content-Guided Video Synthesis with Diffusion Models
Runway Research
Patrick Esser, Johnathan Chiu, Parmida Atighehchian, Jonathan Granskog, Anastasis Germanidis
Year
2023
Runway Research 2023 | All rights reserved.

Runway Research:
Making the impossible

The magic of Runway takes cutting edge research in artificial intelligence and machine learning. All done in-house and in collaboration with leading institutes world-wide.
Explore Careers