2021 . 02 . 02
Online

AI-Café presents: Employing AI for the semantic analysis of conventional and immersive video

February 2nd, 2021 (from 3 PM to 4PM CET)

Speaker:

Hannes Fassold

(JOANNEUM RESEARCH)

Description of the Talk:

AI-based methods are nowadays the best choice for the automatic extraction of semantic metadata from archive content. This session will describe our experience employing deep learning algorithms for face detection and recognition as well as general object detection and tracking.

We will discuss the current state of these methods and highlight issues that are still remaining, like the ethnic bias occurring in all face recognition methods trained on public datasets. We will then present use cases on how these methods can help archives annotate and exploit their content in a more convenient way. We address here not only conventional video content, but also emerging content types like immersive video, which pose new challenges for archives. We will show how face recognition and scene object extraction can be used for the semi-automatic annotation of video content and for automatic cinematography / editing of a 360° video.

Speaker's short bio:

Hannes Fassold received a MSc degree in Applied Mathematics from Graz University of Technology in 2004. Since then he works at JOANNEUM RESEARCH, where he is currently a senior researcher at the Machine Vision Applications Group of the DIGITAL institute.

His main research interests are the automatic analysis and enhancement of video (e.g. object detection & tracking, optical flow, speaker recognition, defect detection, superresolution, denoising) with deep learning methods. He has published several publications in these fields and coordinates the machine learning workflow / infrastructure at DIGITAL.

Watch the recording


AI-Café Team

Carmen Mac Williams Organizer, and Moderator of the AI-Cafe. She is the Director of the company Grassroots Arts, and a partner in the European AI4media project.

Emma and Theresa Co-organisers and co-moderators for this new season of Café Season. They are Research Assistants at Grassroots Arts.


This Café is organized by Grassroots Arts. If you have questions about the organisation of this AI-Café or if you want to become a Speaker yourself in one of the next Web Cafe Sessions, please contact carmen@grassroots-arts.eu.

The recordings of the past Web Cafes you can find on our AI-Café video channel: https://www.gotostage.com/channel/ai-cafe. Here is the link to the AI-Cafe website: https://ai-cafe.eu/

AI-Cafe WEBCAFE – INFORMATION LEGAL NOTICE > HERE

COOKIES

AI4Media may use cookies to store your login data, collect statistics to optimize the website's functionality and to perform marketing actions based on your interests.

COOKIES
They allow you to browse the website and use its applications as well as to access secure areas of the website. Without these cookies, the services you have requested cannot be provided.
These cookies are necessary to allow the main functionality of the website and they are activated automatically when you enter this website. They store user preferences for site usage so that you do not need to reconfigure the site each time you visit it.
These cookies direct advertising according to the interests of each user so as to direct advertising campaigns, taking into account the tastes of users, and they also limit the number of times you see the ad, helping to measure the effectiveness of advertising and the success of the website organisation.

Required Cookies They allow you to browse the website and use its applications as well as to access secure areas of the website. Without these cookies, the services you have requested cannot be provided.

Functional Cookies These cookies are necessary to allow the main functionality of the website and they are activated automatically when you enter this website. They store user preferences for site usage so that you do not need to reconfigure the site each time you visit it.

Advertising Cookies These cookies direct advertising according to the interests of each user so as to direct advertising campaigns, taking into account the tastes of users, and they also limit the number of times you see the ad, helping to measure the effectiveness of advertising and the success of the website organisation.