Software to automatically convert movies into comics

GS. Meng Wang of Hefei University of Technology (China) and colleagues announced the "Movie2Comics" software, which automatically converts movie scenes into comics, without any human intervention. .

Some comics today are still drawn by hand, many modern painters have used some digital tools to create comics. But even with the help of these tools, creating comics is still a very time-consuming process.

"Movie2Comics" is a tool not only for professionals, but ordinary lovers can also use.

Picture 1 of Software to automatically convert movies into comics
Some scenes from the movie "Titanic" were turned into comics. (Source: Physorg)

Previously there were programs to support converting movies to comics, but the new method was the first fully automated tool that humans did not have to intervene manually. Therefore, it greatly reduces the time and cost of creating comics.

In order to use the software, users have to manipulate a number of steps, such as using the character facial algorithm to identify the character on the screen. The software automatically creates story boxes of different sizes and then sets the voice memo boxes corresponding to the character.

The researchers used this method to transfer 15 excerpts from 2 to 7 minutes in Titanic, Sherlock Holmes . to successful comics.

However, the accuracy of face recognition algorithm is only 85%, so sometimes it puts the speech box into the wrong character. Researchers say they will continue to improve accuracy.

Although this technique can be fully converted automatically, researchers emphasize that if there is human help, the efficiency of the software will be much better.