وائل علي بسيوني سلطان
مدرس مساعد
Optimized WFST-Based ASR for Arabic: Balancing Memory, Speed, and Accuracy
Journal of Computer Science • 2025
معلومات البحث
المؤلفون
Sherif M Abdou Wael A. Sultan, Mourad S. Semary
الكلمات المفتاحية
FST-decoding, ASR, Arabic language, Model footprint, WFST
المجلة العلمية
Journal of Computer Science
الناشر
Science Publications
المجلد
Not Available
العدد
Not Available
الصفحات
Not Available
publication.type
International
رابط البحث
Not Available
المواد المرفقة
Not Available
الملخص
Weighted finite-state transducers (WFSTs) have revolutionized
automatic speech recognition (ASR) by enabling significantly faster decoding
speeds compared to traditional systems that build the search space
progressively. However, applying WFSTs to morphology-rich languages
such as Arabic presents challenges due to the large vocabulary, resulting in
extensive networks that exceed the memory capacity of standard CPUs. This
study introduces various strategies to reduce the size of large vocabulary
Arabic WFSTs with minimal impact on accuracy. We employed a star
architecture for the network topology, which effectively reduced the network
size and improved the decoding speed. Additionally, a two-pass decoding
approach was adopted: the first pass used a smaller network with a short
history language model, and the second pass rescored the produced lattice
with a longer history language model. We explored several tuning parameters
to find the optimal balance between network size and accuracy. Our results
show that by using an optimized search graph built with a 2-gram language
model instead of a 3-gram model, we achieve a 45% reduction in the graph’s
memory footprint with a negligible accuracy loss of less than 0.2% MR-WER.
On the MGB3 benchmark, our method achieved 40x real-time Arabic ASR
data processing with an accuracy of 83.67%, compared to the 85.82% accuracy
of state-of-the-art systems, which only achieve 8x real-time performance on
standard CPUs.
automatic speech recognition (ASR) by enabling significantly faster decoding
speeds compared to traditional systems that build the search space
progressively. However, applying WFSTs to morphology-rich languages
such as Arabic presents challenges due to the large vocabulary, resulting in
extensive networks that exceed the memory capacity of standard CPUs. This
study introduces various strategies to reduce the size of large vocabulary
Arabic WFSTs with minimal impact on accuracy. We employed a star
architecture for the network topology, which effectively reduced the network
size and improved the decoding speed. Additionally, a two-pass decoding
approach was adopted: the first pass used a smaller network with a short
history language model, and the second pass rescored the produced lattice
with a longer history language model. We explored several tuning parameters
to find the optimal balance between network size and accuracy. Our results
show that by using an optimized search graph built with a 2-gram language
model instead of a 3-gram model, we achieve a 45% reduction in the graph’s
memory footprint with a negligible accuracy loss of less than 0.2% MR-WER.
On the MGB3 benchmark, our method achieved 40x real-time Arabic ASR
data processing with an accuracy of 83.67%, compared to the 85.82% accuracy
of state-of-the-art systems, which only achieve 8x real-time performance on
standard CPUs.
