Centroid-aware local discriminative metric learning in speaker verification.

Kekai Sheng (1, 2) , Weiming Dong (1) , Wei Li , Joseph Razik (3) , Feiyue Huang , Baogang Hu (1)

1 LIAMA - Laboratoire Franco-Chinois d'Informatique, d'Automatique et de Mathématiques Appliquées
2 UCAS - University of Chinese Academy of Sciences [Beijing]
3 LIS - Laboratoire d'Informatique et Systèmes

We propose a new mechanism to pave the way for efficient learning against class-imbalance and improve representation of identity vector (i-vector) in automatic speaker verification (ASV). The insight is to effectively exploit the inherent structure within ASV corpus — centroid priori. In particular: (1) to ensure learning efficiency against class-imbalance, the centroid-aware balanced boosting sampling is proposed to collect balanced mini-batch; (2) to strengthen local discriminative modeling on the mini-batches, neighborhood component analysis (NCA) and magnet loss (MNL) are adopted in ASV-specific modifications. The integration creates adaptive NCA (AdaNCA) and linear MNL (LMNL). Numerical results show that LMNL is a competitive candidate for low-dimensional projection on i-vector (EER = 3.84% on SRE2008, EER = 1.81% on SRE2010), enjoying competitive edge over linear discriminant analysis (LDA). AdaNCA (EER = 4.03% on SRE2008, EER = 2.05% on SRE2010) also performs well. Furthermore, to facilitate the future study on boosting sampling, connections between boosting sampling, hinge loss and data augmentation have been established, which help understand the behavior of boosting sampling further.

Keywords: Linear MagNet; Centroid-aware balanced boosting sampling; Adaptive neighborhood component analysis; Linear MagNet; Text-Independent ASV; Centroid-Aware Balanced Boosting Sampling; Adaptive Neighborhood Component Analysis

Domains: Machine Learning [cs.LG]; Computer Vision and Pattern Recognition [cs.CV]; Sound [cs.SD]; Signal and Image Processing

Kekai Sheng, Weiming Dong, Wei Li, Joseph Razik, Feiyue Huang, et al.. Centroid-aware local discriminative metric learning in speaker verification.. Pattern Recognition, 2017, 72 (c), pp.176-185. ⟨10.1016/j.patcog.2017.07.007⟩. ⟨hal-01769892⟩