Microphone Array Channel Combination Algorithms for Overlapped Speech Detection - Archive ouverte HAL Access content directly
Conference Papers Year :

Microphone Array Channel Combination Algorithms for Overlapped Speech Detection

(1, 2) , (2) , (1) , (1)
1
2

Abstract

Overlapped speech occurs when multiple speakers are simultaneously active. This may lead to severe performance degradation in automatic speech processing systems such as speaker diarization. Overlapped speech detection (OSD) aims at detecting time segments in which several speakers are simultaneously active. Recent deep neural network architectures have shown impressive results in the close-talk scenario. However, performance tends to deteriorate in the context of distant speech. Microphone arrays are often considered under these conditions to record signals including spatial information. This paper investigates the use of the self-attention channel combinator (SACC) system as a feature extractor for OSD. This model is also extended in the complex space (cSACC) to improve the interpretability of the approach. Results show that distant OSD performance with self-attentive models gets closer to the nearfield condition. A detailed analysis of the cSACC combinationweights is also conducted showing that the self-attention module focuses attention on the speakers' direction.
Fichier principal
Vignette du fichier
220114_interspeech2022_reviewed.pdf (2.34 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03713385 , version 1 (05-07-2022)

Identifiers

  • HAL Id : hal-03713385 , version 1

Cite

Théo Mariotte, Anthony Larcher, Silvio Montrésor, Jean-Hugh Thomas. Microphone Array Channel Combination Algorithms for Overlapped Speech Detection. Interspeech 2022 Human and Humanizing Speech Technology, Sep 2022, Incheon, South Korea. ⟨hal-03713385⟩
99 View
83 Download

Share

Gmail Facebook Twitter LinkedIn More