Comparison of the order reducing (ORED) and fast incremental training (FIT) algorithms for training high order hidden Markov models

Date
1997
Authors
du Preez J.A.
Weber D.M.
Journal Title
Journal ISSN
Volume Title
Publisher
Abstract
In an accompanying paper we detailed the ORED mid FIT algorithms which are both applicable to the training of high order hidden Markov models (HMM). Due to the presence of local optima, the training algorithms are not guaranteed to converge to the same result. In this paper we use simulations as well as experiments on speech to investigate some differences between them. We show that the FIT algorithm requires a fraction of the computational requirements, while simultaneously providing better accuracy and generalization compared to the ORED approach. The experiments indicate that the FIT algorithm provides a practical approach to training high order HMMs in circumstances which might ordinarily be considered as unfeasible.
Description
Keywords
Computer simulation, Markov processes, Mathematical models, Fast incremental training (FIT) algorithms, Hidden Markov models (HMM), Order reducing (ORED) algorithms, Algorithms
Citation
Proceedings of the South African Symposium on Communications and Signal Processing, COMSIG