Efficient Punctuation Restoration via Weighted Lookahead Scoring Method for Streaming ASR Systems
Quick Answer
This paper introduces a non-autoregressive scoring method for punctuation restoration in streaming ASR systems, achieving a macro F1 score of 0.893 without fine-tuning and 0.937 after fine-tuning on the IWSLT 2017 benchmark.
Quick Take
The method uses a bounded K-subword-token lookahead to make incremental punctuation decisions, significantly outperforming existing prompt-based and ELECTRA baselines.
Key Points
- Achieved a macro F1 score of 0.893 without fine-tuning on IWSLT 2017.
- Fine-tuning improved the score to 0.937, outperforming prompt-based methods.
- Utilizes a bounded K-subword-token lookahead for efficient decision-making.
- Non-autoregressive method avoids latency and alignment issues in streaming ASR.
- No parameter updates are required during inference, enhancing real-time performance.
Paper Resources
Source Excerpt
arXiv:2606. 05179v1 Announce Type: new Abstract: Punctuation restoration improves ASR (Automatic Speech Recognition) readability. However streaming ASR requires online decisions with limited future context. In streaming ASR, the system predicts punctuation incrementally, which makes generation-based approaches prone to latency and alignment failures under boundary-wise evaluation.
This paper proposes a non-autoregressive scoring method (no free-form generation) that preserves the input transcript and makes a decision at each word boundary. …
Want this in your inbox every morning?
Daily brief at your local 8am — bilingual EN/中文, free.
More from arXiv cs.CL
See more →RF-Agent: A Practical Framework for Building Language Agents for RFIC Design
RF-Agent introduces a novel framework for RF circuit design using , creating a unique RF-domain reasoning dataset with over 11,000 samples. The study reveals that domain-specific supervised fine-tuning and semantic retrieval strategies significantly enhance RF reasoning performance, particularly for smaller models.