Artificial Intelligence Producing Video from Text: Stable Video Diffusion

Just like OpenAI, it is one of the leading companies producing artificial intelligence-supported technologies. Stability AImade a very important announcement today. In this announcement, the company’s new artificial intelligence model “Stable Video Diffusion” was introduced. Built on the company’s artificial intelligence model “Stable Diffusion”, which helps produce images from text, the new model converts texts first into images and then into videos.

Stable Video Diffusion, yet early stage an artificial intelligence model. As such, it is not available to everyone. However, Stability AI’s lucky individual and commercial license users can already try the company’s new artificial intelligence model. Meanwhile; The examples shared for Stable Video Diffusion show that the technology is not at all it’s not bad it reveals.

Here are some sample videos produced with Stable Video Diffusion:

According to the statements made by Stability AI, the new artificial intelligence model is in the form of SVD and SVD-XT. two different output formats can produce. SVD format converts 14 frames into video with a resolution of 576×1024 pixels. SVD-XT, on the other hand, can use 24 frames for one content. In both formats Between 3 and 30 fps image can be taken.

Stable Video Diffusion, millions of videos A model used for education. The company retrained the model, which it trained with such a huge data set, using approximately one million videos in the second stage. The second training enabled fine-tuning the images produced by Stable Video Diffusion. However, the company did not make a statement about where it obtained the videos used in its data sets. In fact, the company says that the training data is taken from royalty-free and public databases, but it does not explain how this is done. no one knows.

According to Stability AI’s statement, the new artificial intelligence model is actually commercial use for was designed. The company says that the technology it has developed will make things easier in some sectors such as advertising, education and entertainment. However, it should not be overlooked that there are some problems that its individual use may cause. All in all deepfake We all know the consequences of technology…

Here are some ways Stable Video Diffusion can eliminate the risks of individual use. limitations Contains. According to the statements made, this artificial intelligence model does not allow reorganization. Additionally, a person’s face may not match the one in the text. In addition to all this, the new artificial intelligence model also produces images that are largely still or contain slow camera effects. does not produce. It is currently unclear whether the team will be able to protect consumers with these methods.