Optimizing Two-Pass Cross-Lingual Transfer Learning: Phoneme Recognition And Phoneme To Grapheme Translation
- Title
- Optimizing Two-Pass Cross-Lingual Transfer Learning: Phoneme Recognition And Phoneme To Grapheme Translation
- Authors
- LEE, GARY GEUNBAE; Lee, Wonjun; Kim, Yunsu
- Date Issued
- 2023-12-16
- Publisher
- Institute of Electrical and Electronics Engineers Inc.
- Abstract
- This research optimizes two-pass cross-lingual transfer learning in low-resource languages by enhancing phoneme recognition and phoneme-to-grapheme translation models. Our approach optimizes these two stages to improve speech recognition across languages. We optimize phoneme vocabulary coverage by merging phonemes based on shared articulatory characteristics, thus improving recognition accuracy. Additionally, we introduce a global phoneme noise generator for realistic ASR noise during phoneme-to-grapheme training to reduce error propagation. Experiments on the CommonVoice 12.0 dataset show significant reductions in Word Error Rate (WER) for low-resource languages, highlighting the effectiveness of our approach. This research contributes to the advancements of two-pass ASR systems in low-resource languages, offering the potential for improved cross-lingual transfer learning.
- URI
- https://oasis.postech.ac.kr/handle/2014.oak/121218
- Article Type
- Conference
- Citation
- 2023 IEEE Automatic Speech Recognition and Understanding Workshop, ASRU 2023, 2023-12-16
- Files in This Item:
- There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.