IMT: How to transform videos into words?
The H2020 MeMAD project ambitions to develop a set of technologies that will describe comprehensively videos, ranging from visual objects, people and motions that can be seen, to music, sounds…
Read more
Audiovisual media content is an essential resource of modern history. It’s our way to communicate and to entertain. To fully benefit from multilingual audiovisual content, we need efficient tools to make visual content accessible in words.
What is MeMAD providing?
We provide new methods that help to translate moving images and sounds into words. MeMAD methods will help us to manage large amounts of audiovisual data cost efficiently.
Who will benefit from MeMAD?
Anyone using audiovisual content will benefit from MeMAD. Professionals who work in the Creative Industries will receive new methods for video management and digital storytelling. Visually and hearing impaired, among others, will have better access to video content.
MeMAD is an EU funded H2020 research project (2018-2020). MeMAD will develop methods for an efficient re-use and re-purpose of multilingual audiovisual content targeting to revolutionize video management and digital storytelling in broadcasting and media production.
“We go far beyond the state-of-the-art automatic video description methods by making the machine learn from the human. The resulting description is thus not only a time-aligned semantic extraction of objects but makes use of the audio and recognizes action sequences.”
MeMAD’s main results are detailed, rich descriptions of the moving images, speech, and audio. We integrate the latest research achievements in deep neural network techniques in computer vision with knowledge bases, human and machine translation in a continuously improving machine learning framework.
Project partners
Latest news
Satakunnan Kansa: What happened to reading?
MeMAD researcher Maija Hirvonen (University of Helsinki) analyzes what happens to our ability to read when videos are taking over in our everyday communication. Read more here (only in Finnish).
Lingsoft: Artificial intelligence to revolutionize the management of audiovisual materials
Press release, free for publication 4 March 2018 Lingsoft is part of an EU project that is set to revolutionize the management of large video collections. The project aims to…
Lingsoft: Artificiell intelligens revolutionerar hanteringen av audiovisuellt material
Pressmeddelande, fri för publicering 4.4.2018 Lingsoft är med i ett EU-projekt, som revolutionerar hanteringen av stora videosamlingar. Projektets syfte är att skapa nästa generations medieupplevelse genom att kombinera effektiviteten…
Lingsoft: Tekoäly mullistaa audiovisuaalisen aineiston hallinnan
Tiedote, vapaa julkaistavaksi 27.3.2018 Lingsoft on mukana EU-hankkeessa, joka mullistaa suurten videokokoelmien käsittelyn. Hankkeen tarkoituksena on rakentaa seuraavan sukupolven mediakokemusta yhdistämällä tekoälyn tuoma tehokkuus ihmistyön tarkkuuteen. Vuoden 2018 alussa käynnistynyt…
Turun Sanomat: What happened to reading?
MeMAD researcher Maija Hirvonen (University of Helsinki) was interviewed by a Finnish newspaper Turun Sanomat about what happens to our ability to read when videos are taking over in our…
More news and newsletters