Audiovisual media content is an essential resource of modern history. It’s our way to communicate and to entertain. To fully benefit from multilingual audiovisual content, we need efficient tools to make visual content accessible in words.
We provide new methods that help to translate moving images and sounds into words. MeMAD methods will help us to manage large amounts of audiovisual data cost efficiently.
Anyone using audiovisual content will benefit from MeMAD. Professionals who work in the Creative Industries will receive new methods for video management and digital storytelling. Visually and hearing impaired, among others, will have better access to video content.
MeMAD is an EU funded H2020 research project (2018-2020). MeMAD will develop methods for an efficient re-use and re-purpose of multilingual audiovisual content targeting to revolutionize video management and digital storytelling in broadcasting and media production.
“We go far beyond the state-of-the-art automatic video description methods by making the machine learn from the human. The resulting description is thus not only a time-aligned semantic extraction of objects but makes use of the audio and recognizes action sequences.”
MeMAD’s main results are detailed, rich descriptions of the moving images, speech, and audio. We integrate the latest research achievements in deep neural network techniques in computer vision with knowledge bases, human and machine translation in a continuously improving machine learning framework.
MeMAD researcher Maija Hirvonen (University of Helsinki) analyzes what happens to our ability to read when videos are taking over in our everyday communication. Read more here (only in Finnish).
Press release, free for publication 4 March 2018 Lingsoft is part of an EU project that is set to revolutionize the management of large video collections. The project aims to…
Pressmeddelande, fri för publicering 4.4.2018 Lingsoft är med i ett EU-projekt, som revolutionerar hanteringen av stora videosamlingar. Projektets syfte är att skapa nästa generations medieupplevelse genom att kombinera effektiviteten…
Tiedote, vapaa julkaistavaksi 27.3.2018 Lingsoft on mukana EU-hankkeessa, joka mullistaa suurten videokokoelmien käsittelyn. Hankkeen tarkoituksena on rakentaa seuraavan sukupolven mediakokemusta yhdistämällä tekoälyn tuoma tehokkuus ihmistyön tarkkuuteen. Vuoden 2018 alussa käynnistynyt…
MeMAD researcher Maija Hirvonen (University of Helsinki) was interviewed by a Finnish newspaper Turun Sanomat about what happens to our ability to read when videos are taking over in our…
Transforming audiovisual information into words will revolutionize handling of huge media archives when artificial intelligence is taught how to describe videos. Read more here (only in Finnish).
Uusi menetelmä yhdistää tekstikuvailuun sekä videolla kuuluvan puheen että kuvan sisällön ja tuottaa tekstin suoraan halutulle kielelle. Tammikuussa 2018 alkaneessa EU:n rahoittamassa projektissa kehitetään Aalto-yliopiston uusimpiin kuvan- ja äänenkäsittelyn tutkimustuloksiin…
Yle’s newsletter about how methods developed in EU project can revolutionize handling of audiovisual archives. Read more here (only in Finnish).
In future, will artificial intelligence watch videos and listen to podcasts for you? Will it serve you the best clips or translate videos to languages that you understand? Will machines…
The seminar presents MeMAD (Methods for managing audiovisual data: combining automatic efficiency with human accuracy), a new three year research and innovation project to develop efficient and accurate automatic language-based…