Multi-accent acoustic modelling of South African English
Date
2012
Authors
Kamper H.
Muamba Mukanya F.J.
Niesler T.
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
Although English is spoken throughout South Africa it is most often used as a second or third language, resulting in several prevalent accents within the same population. When dealing with multiple accents in this under-resourced environment, automatic speech recognition (ASR) is complicated by the need to compile multiple, accent-specific speech corpora. We investigate how best to combine speech data from five South African accents of English in order to improve overall speech recognition performance. Three acoustic modelling approaches are considered: separate accent-specific models, accent-independent models obtained by pooling training data across accents, and multi-accent models. The latter approach extends the decision-tree clustering process normally used to construct tied-state hidden Markov models (HMMs) by allowing questions relating to accent. We find that multi-accent modelling outperforms accent-specific and accent-independent modelling in both phone and word recognition experiments, and that these improvements are statistically significant. Furthermore, we find that the relative merits of the accent-independent and accent-specific approaches depend on the particular accents involved. Multi-accent modelling therefore offers a mechanism by which speech recognition performance can be optimised automatically, and for hard decisions regarding which data to pool and which to separate to be avoided. © 2012 Elsevier B.V. All rights reserved.
Description
Keywords
Acoustic modelling, Automatic speech recognition, Clustering process, Hard decisions, Hidden markov models (HMMs), South Africa, South African English accents, Speech corpora, Speech data, Speech recognition performance, Training data, Word recognition, Clustering algorithms, Hidden Markov models, Separation, Speech recognition
Citation
Speech Communication
54
6
801
813
54
6
801
813