Por favor, use este identificador para citar o enlazar este ítem: https://hdl.handle.net/10953/2188
Título: Multimodal speaker diarization for meetings using volume-evaluated SRP-PHAT and video analysis
Autoría: Cabañas-Molero, Pablo Antonio
Lucena, Manuel
Fuertes, José Manuel
Vera-Candeas, Pedro
Ruiz-Reyes, Nicolás
Resumen: Speaker diarization is traditionally defined as the problem of determining “who speaks when” given an audio or video stream. This is an important task in many applications for meeting rooms, including automatic transcription of conversations, camera steering or content summarization. When the room is equipped with microphone arrays and cameras, speakers can be distinguished according to their location and the problem can be addressed through localization techniques. This article proposes a multimodal speaker diarization system for meeting environments based on a modified SRP-PHAT function evaluated on space volumes rather than discrete points. In our system, this function is used in combination with a circular array, enabling audio-based localization based on the selection of local maxima. Voicing detection is used to detect speech frames, whereas video analysis is introduced to aid in the decision when users move or simultaneously speak. The approach is evaluated on the well-known AMI dataset with approximately 100 hours of realistic meeting recordings and shows an average diarization error rate of 21% – 25%.
Palabras clave: Speaker diarization
Meeting rooms
SRP-PHAT
Multimodal processing
Fecha: 11-abr-2018
Patrocinador: This work was supported by the Andalusian Economy and Knowledge Council under project 2010-TIC6762, and the Spanish Ministry of Economy and Competitiveness under project TEC2015-67387-C4-2-R.
Editorial: Springer
Citación: Cabañas-Molero, P., Lucena, M., Fuertes, J.M. et al. Multimodal speaker diarization for meetings using volume-evaluated SRP-PHAT and video analysis. Multimed Tools Appl 77, 27685–27707 (2018). https://doi.org/10.1007/s11042-018-5944-2
Aparece en las colecciones: DIT-Artículos

Ficheros en este ítem:
Fichero Descripción Tamaño Formato  
Multimedia_tools_2018.pdfPDF del artículo1,47 MBAdobe PDFVisualizar/Abrir


Este ítem está protegido por copyright original