A Source/Filter Model with Adaptive Constraints for NMF-based Speech Separation - Sorbonne Université Access content directly
Conference Papers Year :

A Source/Filter Model with Adaptive Constraints for NMF-based Speech Separation

Damien Bouvier
Nicolas Obin
Axel Roebel


This paper introduces a constrained source/filter model for semi-supervised speech separation based on non-negative matrix factor-ization (NMF). The objective is to inform NMF with prior knowledge about speech, providing a physically meaningful speech separation. To do so, a source/filter model (indicated as Instantaneous Mixture Model or IMM) is integrated in the NMF. Furthermore , constraints are added to the IMM-NMF, in order to control the NMF behaviour during separation, and to enforce its physical meaning. In particular, a speech specific constraint-based on the source/filter coherence of speech-and a method for the automatic adaptation of constraints' weights during separation are presented. Also, the proposed source/filter model is semi-supervised: during training, one filter basis is estimated for each phoneme of a speaker; during separation, the estimated filter bases are then used in the constrained source/filter model. An experimental evaluation for speech separation was conducted on the TIMIT speakers database mixed with various environmental background noises from the QUT-NOISE database. This evaluation showed that the use of adap-tive constraints increases the performance of the source/filter model for speaker-dependent speech separation, and compares favorably to fully-supervised speech separation. Index Terms: speech separation, non-negative matrix factorization, source/filter model, constraints.
Fichier principal
Vignette du fichier
ICASSP16_DB.pdf (6.66 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-01294681 , version 1 (30-03-2016)


  • HAL Id : hal-01294681 , version 1


Damien Bouvier, Nicolas Obin, Marco Liuni, Axel Roebel. A Source/Filter Model with Adaptive Constraints for NMF-based Speech Separation. International Conference on Acoustics, Speech, and Signal Processing, Mar 2016, Shanghai, China. ⟨hal-01294681⟩
177 View
262 Download


Gmail Facebook Twitter LinkedIn More