{"id":22910,"date":"2025-06-02T12:21:28","date_gmt":"2025-06-02T10:21:28","guid":{"rendered":"https:\/\/saarland-informatics-campus.de\/?post_type=sic_news&p=22910"},"modified":"2025-06-02T12:21:28","modified_gmt":"2025-06-02T10:21:28","slug":"hollywood-discovers-saarbrucken-based-research-for-the-film-industry","status":"publish","type":"sic_news","link":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/","title":{"rendered":"Hollywood Discovers Saarbr\u00fccken-Based Research for the Film Industry"},"content":{"rendered":"
\n
\n
\n
\n
\n
\n

First Fully AI-Dubbed Film Launched in U.S. Theaters<\/h3>\n<\/header>\n
\n
\n
\n

Dubbed films often suffer from mismatched lip movements and audio, which can disrupt the viewing experience. An internationally operating UK-based startup has now developed a solution to this problem\u2014inspired by research from the Max Planck Institute for Informatics in Saarbr\u00fccken, Germany: using artificial intelligence, the system retroactively adjusts the actors\u2019 lip movements in movies to match new target languages. The first feature film entirely processed with this approach <\/strong>premiered last week in about 100 U.S. cinemas.<\/strong><\/p>\n

The film “Watch The Skies” (originally titled “UFO Sweden”) was dubbed using “TrueSync”, a technology developed by the AI startup “FlawlessAI”. The inspiration for its development came from the scientific paper “Deep Video Portraits”, published in 2018 at ACM SIGGRAPH, one of the world\u2019s leading conferences in computer graphics research.<\/p>\n

\u201cThe paper described a novel method that combined deep neural networks with traditional computer graphics concepts to produce, by the standards of the time, highly convincing head re-animations in nearly all visual aspects, all from a single input video,\u201d explains Professor Christian Theobalt, Director at the Max Planck Institute for Informatics and head of the “Visual Computing and Artificial Intelligence” department.<\/p>\n

Because ACM SIGGRAPH also attracts professionals from the visual effects and video game industries in addition to researchers, it was at the conference that Christian Theobalt met Scott Mann, who later founded and now serves as CEO of FlawlessAI. \u201cScott was already working as a director in Hollywood at the time. He saw great potential in further developing our approach, which we had originally conceived as a kind of \u2018proof of concept, to make films more accessible to wider audiences and at the same time create additional revenue opportunities for actors and filmmakers,\u201d says Theobalt.<\/p>\n

At a subsequent meeting in Saarbr\u00fccken, the decision was made to found the company, with which Christian Theobalt has been closely collaborating since the very beginning. Two of FlawlessAI\u2019s lead scientists are former doctoral students of his. Several joint research projects have already been conducted, and an expansion of the collaboration in Saarbr\u00fccken is currently under discussion. In addition to “Watch the Skies”, several more films using the AI-dubbing technology are already planned for release on the U.S. market\u2014including the German Berlinale opening film “The Light” (Das Licht).<\/p>\n

Further Information:<\/strong>
\nhttps:\/\/www.flawlessai.com\/watch-the-skies<\/a><\/p>\n

Department website \u201cVisual Computing and Artificial Intelligence\u201d: https:\/\/www.mpi-inf.mpg.de\/de\/departments\/visual-computing-and-artificial-intelligence<\/a><\/p>\n

Deep Video Portraits (2018): https:\/\/gvv.mpi-inf.mpg.de\/projects\/DeepVideoPortraits\/<\/a><\/p>\n

Questions answers:<\/strong>
\nProf. Dr. Christian Theobalt
\nScientific Director, Max Planck Institute for Informatics<\/p>\n

Editor and Contact:<\/strong>
\nPhilipp Zapf-Schramm
\nMax Planck Institute for Informatics
\nPhone: +49 681 9325 5409
\nEmail: pzs@mpi-inf.mpg.de<\/a><\/p>\n

Press release\u00a0<\/strong>of the Max Planck Institute for Informatics: https:\/\/www.mpi-inf.mpg.de\/news\/detail\/hollywood-discovers-saarbruecken-based-research-for-the-film-industry<\/a><\/p>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

First Fully AI-Dubbed Film Launched in U.S. Theaters Dubbed films often suffer from mismatched lip movements and audio, which can disrupt the viewing experience. An internationally operating UK-based startup has now developed a solution to this problem—inspired by research from the Max Planck Institute for Informatics in Saarbrücken, Germany: using artificial intelligence, the system retroactively […]<\/p>\n","protected":false},"featured_media":22909,"menu_order":0,"template":"","meta":{"_et_pb_use_builder":"","_et_pb_old_content":"","_et_gb_content_width":""},"sic_news-types":[56,59],"class_list":["post-22910","sic_news","type-sic_news","status-publish","has-post-thumbnail","hentry","sic_news-types-mpi-inf-en","sic_news-types-press-release-en"],"yoast_head":"\nHollywood Discovers Saarbr\u00fccken-Based Research for the Film Industry - Saarland Informatics Campus<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Hollywood Discovers Saarbr\u00fccken-Based Research for the Film Industry - Saarland Informatics Campus\" \/>\n<meta property=\"og:description\" content=\"First Fully AI-Dubbed Film Launched in U.S. Theaters Dubbed films often suffer from mismatched lip movements and audio, which can disrupt the viewing experience. An internationally operating UK-based startup has now developed a solution to this problem—inspired by research from the Max Planck Institute for Informatics in Saarbrücken, Germany: using artificial intelligence, the system retroactively […]\" \/>\n<meta property=\"og:url\" content=\"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/\" \/>\n<meta property=\"og:site_name\" content=\"Saarland Informatics Campus\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/sic.informatik.saarland\/\" \/>\n<meta property=\"og:image\" content=\"https:\/\/saarland-informatics-campus.de\/wp-content\/uploads\/csm_MPI_Lightstage_64611_e8bd49f2c7.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"600\" \/>\n\t<meta property=\"og:image:height\" content=\"449\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/piece-of-news\\\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\\\/\",\"url\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/piece-of-news\\\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\\\/\",\"name\":\"Hollywood Discovers Saarbr\u00fccken-Based Research for the Film Industry - Saarland Informatics Campus\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/piece-of-news\\\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\\\/#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/piece-of-news\\\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\\\/#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/wp-content\\\/uploads\\\/csm_MPI_Lightstage_64611_e8bd49f2c7-e1749641988105.jpg\",\"datePublished\":\"2025-06-02T10:21:28+00:00\",\"breadcrumb\":{\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/piece-of-news\\\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\\\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/piece-of-news\\\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\\\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/piece-of-news\\\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\\\/#primaryimage\",\"url\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/wp-content\\\/uploads\\\/csm_MPI_Lightstage_64611_e8bd49f2c7-e1749641988105.jpg\",\"contentUrl\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/wp-content\\\/uploads\\\/csm_MPI_Lightstage_64611_e8bd49f2c7-e1749641988105.jpg\",\"width\":600,\"height\":449,\"caption\":\"Foto: Oliver Dietze -- Ver\u00f6ffentlichung nur nach vorheriger Honorar-Vereinbarung und mit Namensnennung. Oliver Dietze \\\/\\\/ +49-(0)177-9761996 \\\/\\\/ post@oliverdietze.de \\\/\\\/ USt-ID DE262797891\"},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/piece-of-news\\\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\\\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"News\",\"item\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/piece-of-news\\\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Hollywood Discovers Saarbr\u00fccken-Based Research for the Film Industry\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/#website\",\"url\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/\",\"name\":\"Saarland Informatics Campus\",\"description\":\"in Saarbr\u00fccken, Germany\",\"publisher\":{\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/#organization\",\"name\":\"Saarland Informatics Campus\",\"url\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\",\"url\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/wp-content\\\/uploads\\\/SIC_logo_1453x343.png\",\"contentUrl\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/wp-content\\\/uploads\\\/SIC_logo_1453x343.png\",\"width\":1453,\"height\":343,\"caption\":\"Saarland Informatics Campus\"},\"image\":{\"@id\":\"https:\\\/\\\/saarland-informatics-campus.de\\\/en\\\/#\\\/schema\\\/logo\\\/image\\\/\"},\"sameAs\":[\"https:\\\/\\\/www.facebook.com\\\/sic.informatik.saarland\\\/\",\"https:\\\/\\\/bsky.app\\\/profile\\\/saarland-informatics-campus.de\",\"https:\\\/\\\/www.instagram.com\\\/saarland_informatics_campus\\\/\",\"https:\\\/\\\/www.youtube.com\\\/channel\\\/UCaDDK5m9CGCzE4xhZTFC6cA\",\"https:\\\/\\\/www.linkedin.com\\\/company\\\/saarland-informatics-campus\"]}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Hollywood Discovers Saarbr\u00fccken-Based Research for the Film Industry - Saarland Informatics Campus","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/","og_locale":"en_US","og_type":"article","og_title":"Hollywood Discovers Saarbr\u00fccken-Based Research for the Film Industry - Saarland Informatics Campus","og_description":"First Fully AI-Dubbed Film Launched in U.S. Theaters Dubbed films often suffer from mismatched lip movements and audio, which can disrupt the viewing experience. An internationally operating UK-based startup has now developed a solution to this problem—inspired by research from the Max Planck Institute for Informatics in Saarbrücken, Germany: using artificial intelligence, the system retroactively […]","og_url":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/","og_site_name":"Saarland Informatics Campus","article_publisher":"https:\/\/www.facebook.com\/sic.informatik.saarland\/","og_image":[{"width":600,"height":449,"url":"https:\/\/saarland-informatics-campus.de\/wp-content\/uploads\/csm_MPI_Lightstage_64611_e8bd49f2c7.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/","url":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/","name":"Hollywood Discovers Saarbr\u00fccken-Based Research for the Film Industry - Saarland Informatics Campus","isPartOf":{"@id":"https:\/\/saarland-informatics-campus.de\/en\/#website"},"primaryImageOfPage":{"@id":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/#primaryimage"},"image":{"@id":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/#primaryimage"},"thumbnailUrl":"https:\/\/saarland-informatics-campus.de\/wp-content\/uploads\/csm_MPI_Lightstage_64611_e8bd49f2c7-e1749641988105.jpg","datePublished":"2025-06-02T10:21:28+00:00","breadcrumb":{"@id":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/#primaryimage","url":"https:\/\/saarland-informatics-campus.de\/wp-content\/uploads\/csm_MPI_Lightstage_64611_e8bd49f2c7-e1749641988105.jpg","contentUrl":"https:\/\/saarland-informatics-campus.de\/wp-content\/uploads\/csm_MPI_Lightstage_64611_e8bd49f2c7-e1749641988105.jpg","width":600,"height":449,"caption":"Foto: Oliver Dietze -- Ver\u00f6ffentlichung nur nach vorheriger Honorar-Vereinbarung und mit Namensnennung. Oliver Dietze \/\/ +49-(0)177-9761996 \/\/ post@oliverdietze.de \/\/ USt-ID DE262797891"},{"@type":"BreadcrumbList","@id":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/hollywood-discovers-saarbrucken-based-research-for-the-film-industry\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/saarland-informatics-campus.de\/en\/"},{"@type":"ListItem","position":2,"name":"News","item":"https:\/\/saarland-informatics-campus.de\/en\/piece-of-news\/"},{"@type":"ListItem","position":3,"name":"Hollywood Discovers Saarbr\u00fccken-Based Research for the Film Industry"}]},{"@type":"WebSite","@id":"https:\/\/saarland-informatics-campus.de\/en\/#website","url":"https:\/\/saarland-informatics-campus.de\/en\/","name":"Saarland Informatics Campus","description":"in Saarbr\u00fccken, Germany","publisher":{"@id":"https:\/\/saarland-informatics-campus.de\/en\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/saarland-informatics-campus.de\/en\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/saarland-informatics-campus.de\/en\/#organization","name":"Saarland Informatics Campus","url":"https:\/\/saarland-informatics-campus.de\/en\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/saarland-informatics-campus.de\/en\/#\/schema\/logo\/image\/","url":"https:\/\/saarland-informatics-campus.de\/wp-content\/uploads\/SIC_logo_1453x343.png","contentUrl":"https:\/\/saarland-informatics-campus.de\/wp-content\/uploads\/SIC_logo_1453x343.png","width":1453,"height":343,"caption":"Saarland Informatics Campus"},"image":{"@id":"https:\/\/saarland-informatics-campus.de\/en\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/sic.informatik.saarland\/","https:\/\/bsky.app\/profile\/saarland-informatics-campus.de","https:\/\/www.instagram.com\/saarland_informatics_campus\/","https:\/\/www.youtube.com\/channel\/UCaDDK5m9CGCzE4xhZTFC6cA","https:\/\/www.linkedin.com\/company\/saarland-informatics-campus"]}]}},"_links":{"self":[{"href":"https:\/\/saarland-informatics-campus.de\/en\/wp-json\/wp\/v2\/sic_news\/22910","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/saarland-informatics-campus.de\/en\/wp-json\/wp\/v2\/sic_news"}],"about":[{"href":"https:\/\/saarland-informatics-campus.de\/en\/wp-json\/wp\/v2\/types\/sic_news"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/saarland-informatics-campus.de\/en\/wp-json\/wp\/v2\/media\/22909"}],"wp:attachment":[{"href":"https:\/\/saarland-informatics-campus.de\/en\/wp-json\/wp\/v2\/media?parent=22910"}],"wp:term":[{"taxonomy":"sic_news-types","embeddable":true,"href":"https:\/\/saarland-informatics-campus.de\/en\/wp-json\/wp\/v2\/sic_news-types?post=22910"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}