Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    An Exploration of Online Games for Adult Gamers 

    November 22, 2023

    Discovering the Elephant Sanctuaries in Bali and the Best Seasons to Visit

    November 8, 2023

    The Ultimate Guide to Buying Cheap Proxies: Everything You Need to Know

    October 19, 2023
    Facebook X (Twitter) Instagram
    Cafe Madrid
    • Business
    • Technology
    • Startups
    • Services
    • Travel
    • Health
    • Guides
    • How to
    • Contact Us
    Cafe Madrid
    Home»News»Meta unveils an AI that generates video from text prompts
    News

    Meta unveils an AI that generates video from text prompts

    Shreya ChristinaBy Shreya ChristinaSeptember 29, 2022No Comments3 Mins Read
    Facebook Twitter Pinterest LinkedIn Tumblr Email
    Share
    Facebook Twitter LinkedIn Pinterest Email

    While the effect is rather crude, the system offers an early glimpse of what’s to come for generative artificial intelligence, and it’s the next obvious step from the text-to-image AI systems that will be huge this year. caused excitement.

    Meta’s announcement of Make-A-Video, which is not yet available to the public, will likely prompt other AI labs to release their own versions. It also raises some big ethical questions.

    In the past month alone, AI lab OpenAI made its latest text-to-image AI system DALL-E available to everyone, and AI startup Stability.AI launched Stable Diffusion, an open-source text-to-image system.

    But text-to-video AI poses even greater challenges. First, these models require an enormous amount of computing power. They are even greater computing power than large text-to-image AI models, which use millions of images to train, because putting together just one short video requires hundreds of images. That means it’s really only big technology companies that can afford to build these systems in the near future. They are also more difficult to train because there are no large-scale datasets of high-quality videos with text.

    To get around this, Meta combined data from three open-source image and video data sets to train his model. Standard text-image datasets of labeled still images helped the AI ​​learn what objects are called and what they look like. And a database of videos helped it learn how those objects should move in the world. The combination of the two approaches helped Make-A-Video, which is described in a non-peer-reviewed paper published todaygenerate videos from text at scale.

    Tanmay Gupta, a computer vision researcher at the Allen Institute for Artificial Intelligence, says Meta’s results are promising. The videos being shared show that the model can capture 3D shapes as the camera rotates. The model also has some sense of depth and understanding of lighting. Gupta says some of the details and movements were done neatly and convincingly.

    “A young couple walking in heavy rain”

    “However, there is plenty of room for the research community to improve, especially if these systems are used for video editing and professional content creation,” he adds. In particular, it is still difficult to model complex interactions between objects.

    In the video generated by the “An artist’s brush on a canvas” prompt, the brush moves across the canvas, but the strokes on the canvas are not realistic. “I would like to see these models succeed in generating a sequence of interactions such as ‘The man takes a book from the shelf, puts on his glasses and sits down to read it while having a cup of coffee,’” Gupta says .

    Share. Facebook Twitter Pinterest LinkedIn Tumblr Email
    Shreya Christina
    • Website

    Shreya has been with cafe-madrid.com for 3 years, writing copy for client websites, blog posts, EDMs and other mediums to engage readers and encourage action. By collaborating with clients, our SEO manager and the wider cafe-madrid.com team, Shreya seeks to understand an audience before creating memorable, persuasive copy.

    Related Posts

    Maharashtra: Watch what happened when the bear and leopard came face to face in the video – Leopard in front of bear in tadoba tiger reserve chandrapur lclg

    April 22, 2023

    SpaceX Starship Launch: Rocket explodes in sky 4 minutes after launch, second attempt fails

    April 20, 2023

    Indonesia has recovered the bodies of 4 soldiers killed in a clash in Papua.

    April 20, 2023
    Editors Picks
    8.5

    Apple Planning Big Mac Redesign and Half-Sized Old Mac

    January 5, 2021

    Autonomous Driving Startup Attracts Chinese Investor

    January 5, 2021

    Onboard Cameras Allow Disabled Quadcopters to Fly

    January 5, 2021
    Top Reviews
    Mobiles

    Review: T-Mobile Winning 5G Race Around the World

    9.1 By Shreya Christina
    Mobiles

    Samsung Galaxy S21 Ultra Review: the New King of Android Phones

    8.9 By Shreya Christina
    Mobiles

    Xiaomi Mi 10: New Variant with Snapdragon 870 Review

    8.9 By Shreya Christina
    Advertisement
    Demo
    About Us

    We are the Simple News website that provide awareness & support to readers. If you find any news or article that belong's to you then contact us anytime, we will remove that things or give you best credit that help for your brand.

    We Accept promotional Articles

    Email : [email protected]

    Our Picks
    Facebook X (Twitter) Instagram Pinterest
    • Home
    • Tech
    • Gadgets
    • Mobiles
    • Buy Now
    © 2023 cafe-madrid.com

    Type above and press Enter to search. Press Esc to cancel.