AI-based methods are nowadays the best choice for the automatic extraction of semantic metadata from archive content. This session will describe our experience employing deep learning algorithms for face detection and recognition as well as general object detection and tracking.
We will discuss the current state of these methods and highlight issues that are still remaining, like the ethnic bias occurring in all face recognition methods trained on public datasets. We will then present use cases on how these methods can help archives annotate and exploit their content in a more convenient way. We address here not only conventional video content, but also emerging content types like immersive video, which pose new challenges for archives. We will show how face recognition and scene object extraction can be used for the semi-automatic annotation of video content and for automatic cinematography / editing of a 360° video.
Hannes Fassold received a MSc degree in Applied Mathematics from Graz University of Technology in 2004. Since then he works at JOANNEUM RESEARCH, where he is currently a senior researcher at the Machine Vision Applications Group of the DIGITAL institute.
His main research interests are the automatic analysis and enhancement of video (e.g. object detection & tracking, optical flow, speaker recognition, defect detection, superresolution, denoising) with deep learning methods. He has published several publications in these fields and coordinates the machine learning workflow / infrastructure at DIGITAL.
Carmen Mac Williams Organizer, and Moderator of the AI-Cafe. She is the Director of the company Grassroots Arts, and a partner in the European AI4media project.
Emma and Theresa Co-organisers and co-moderators for this new season of Café Season. They are Research Assistants at Grassroots Arts.
This Café is organized by Grassroots Arts. If you have questions about the organisation of this AI-Café or if you want to become a Speaker yourself in one of the next Web Cafe Sessions, please contact firstname.lastname@example.org.
The recordings of the past Web Cafes you can find on our AI-Café video channel: https://www.gotostage.com/channel/ai-cafe. Here is the link to the AI-Cafe website: https://ai-cafe.eu/
AI-Cafe WEBCAFE – INFORMATION LEGAL NOTICE > HERE