# arXiv cs.AI: Nepali-English Code-Mixed Speech Recognition: Data Preparation and Adaptation of a Speech Foundation Model [Canonical reading](https://escapemeridian.com/readings/arxiv-cs-ai-nepali-english-code-mixed-speech-recognition-data-6fcabb14) Jeevan Neupane, Janardan Bhetwal, Kshitiz Paudel, Anup Aryal and Bipin Bashyal study adapting SraVaani for Nepali-English code-mixed speech, where speakers mix English words into Nepali conversation. They describe a 172.8-hour corpus across six Nepali speech domains and a tokenizer that does not support digits and several common symbols. Instead of discarding recordings with numbers, they generate Nepali and English readings and use zero-shot ASR output to select a plausible form. The authors report that full fine-tuning lowers test word error rate (WER) from 48.6% to 17.1%; a 12-epoch run reaches 16.3%, close to fine-tuned Whisper large-v3-turbo at 16.4%. Freezing the encoder raises WER to 25.5%, and excluding numeric clips raises WER on numeric test speech from 14.3% to 21.3%. These results make the handling of number-containing speech central to their approach, rather than an incidental data-cleaning choice. On FLEURS, they compare original references with mixed-script alternatives. They conclude that transcription conventions explain part, but not all, of the out-of-domain performance loss. The abstract does not quantify how much each convention contributes. Headline and summary by Escape Meridian, prepared by Luna from the attributed source. A source check is not independent confirmation of the source’s claims. ## Original source arXiv cs.AI · Article Original source date: Nov 10, 2026 (2026-11-10). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T00:02:03.465Z. First observed: 2026-11-11T05:09:24.063Z. Retrieved: 2026-11-11T23:48:32.765Z. - [Nepali-English Code-Mixed Speech Recognition: Data Preparation and Adaptation of a Speech Foundation Model](https://arxiv.org/abs/2611.13512) ## Limits The evidence is the arXiv abstract, not the full paper; it does not provide details needed here to assess the experiments or the corpus composition within each speech domain. The abstract says transcription conventions explain part of the FLEURS out-of-domain performance loss but does not quantify that contribution. ## Open question On FLEURS, how much of the out-of-domain performance loss does the comparison attribute to transcription conventions? ## Source-stated The study adapts SraVaani using a 172.8-hour corpus covering six Nepali speech domains. > We study how to adapt SraVaani, a 449M-parameter hybrid TDT-CTC model, using a 172.8-hour corpus covering six Nepali speech domains. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source-stated The authors address tokenizer limits by generating Nepali and English readings for numbers and using zero-shot ASR output to select a plausible form. > Rather than replace it or discard these recordings, we generate Nepali and English readings for numbers and use zero-shot ASR output to select a plausible form. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source-stated The authors report lower test WER after full fine-tuning, with a 12-epoch run slightly below the reported Whisper large-v3-turbo result. > Full fine-tuning reduces test word error rate (WER) from 48.6% to 17.1%; a 12-epoch run reaches 16.3%, compared with 16.4% for fine-tuned Whisper large-v3-turbo. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source-stated Freezing the encoder and excluding numeric clips are associated with higher WER in the reported evaluations. > Freezing the encoder increases WER to 25.5%, while excluding numeric clips raises WER on numeric test speech from 14.3% to 21.3%. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source-stated The authors say transcription conventions explain some, but not all, of the out-of-domain performance loss. > The comparison shows that transcription conventions explain part, but not all, of the out-of-domain performance loss. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source and contributor context Neupane, Jeevan, Bhetwal, Janardan, Paudel, Kshitiz, Aryal, Anup, Bashyal, Bipin · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Foundation model A large model trained on broad data that can be adapted to many different tasks. - [Definition reference](https://developers.google.com/machine-learning/glossary#foundation-model) ## Model tokens Small chunks of text, often parts of words, that a language model reads and writes; usage and prices are often counted in tokens. - [Definition reference](https://developers.google.com/machine-learning/glossary#token) ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## Fine-tuning Further training of an existing model to adapt it to a particular task or use. - [Definition reference](https://developers.google.com/machine-learning/glossary#fine-tuning) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: fad50c56-9361-4c45-8a45-4c52ab1b7bcc. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T00:02:03.465Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: bfe644637d6b5df2a23f8c4ef722f2509fa6cf95470a00f1dca3d2384dad3727. Source text hash: cae6b1d537b289ee5fa8cf568b08d8b6d2e8bce18ed83ca7abd78a44db66d6b2. ## Revision and source-check history ### Version 1 — 2026-11-12T00:02:03.465Z Jeevan Neupane, Janardan Bhetwal, Kshitiz Paudel, Anup Aryal and Bipin Bashyal study adapting SraVaani for Nepali-English code-mixed speech, where speakers mix English words into Nepali conversation. They describe a 172.8-hour corpus across six Nepali speech domains and a tokenizer that does not support digits and several common symbols. Instead of discarding recordings with numbers, they generate Nepali and English readings and use zero-shot ASR output to select a plausible form. The authors report that full fine-tuning lowers test word error rate (WER) from 48.6% to 17.1%; a 12-epoch run reaches 16.3%, close to fine-tuned Whisper large-v3-turbo at 16.4%. Freezing the encoder raises WER to 25.5%, and excluding numeric clips raises WER on numeric test speech from 14.3% to 21.3%. These results make the handling of number-containing speech central to their approach, rather than an incidental data-cleaning choice. On FLEURS, they compare original references with mixed-script alternatives. They conclude that transcription conventions explain part, but not all, of the out-of-domain performance loss. The abstract does not quantify how much each convention contributes. ## Original source arXiv cs.AI · Article Original source date: Nov 10, 2026 (2026-11-10). Date basis: Date basis not provided. Added to Escape Meridian: 2026-11-12T00:02:03.465Z. First observed: 2026-11-11T05:09:24.063Z. Retrieved: 2026-11-11T23:48:32.765Z. - [Nepali-English Code-Mixed Speech Recognition: Data Preparation and Adaptation of a Speech Foundation Model](https://arxiv.org/abs/2611.13512) ## Limits The evidence is the arXiv abstract, not the full paper; it does not provide details needed here to assess the experiments or the corpus composition within each speech domain. The abstract says transcription conventions explain part of the FLEURS out-of-domain performance loss but does not quantify that contribution. ## Open question On FLEURS, how much of the out-of-domain performance loss does the comparison attribute to transcription conventions? ## Source-stated The study adapts SraVaani using a 172.8-hour corpus covering six Nepali speech domains. > We study how to adapt SraVaani, a 449M-parameter hybrid TDT-CTC model, using a 172.8-hour corpus covering six Nepali speech domains. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source-stated The authors address tokenizer limits by generating Nepali and English readings for numbers and using zero-shot ASR output to select a plausible form. > Rather than replace it or discard these recordings, we generate Nepali and English readings for numbers and use zero-shot ASR output to select a plausible form. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source-stated The authors report lower test WER after full fine-tuning, with a 12-epoch run slightly below the reported Whisper large-v3-turbo result. > Full fine-tuning reduces test word error rate (WER) from 48.6% to 17.1%; a 12-epoch run reaches 16.3%, compared with 16.4% for fine-tuned Whisper large-v3-turbo. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source-stated Freezing the encoder and excluding numeric clips are associated with higher WER in the reported evaluations. > Freezing the encoder increases WER to 25.5%, while excluding numeric clips raises WER on numeric test speech from 14.3% to 21.3%. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source-stated The authors say transcription conventions explain some, but not all, of the out-of-domain performance loss. > The comparison shows that transcription conventions explain part, but not all, of the out-of-domain performance loss. - [Supporting source](https://arxiv.org/abs/2611.13512) ## Source and contributor context Neupane, Jeevan, Bhetwal, Janardan, Paudel, Kshitiz, Aryal, Anup, Bashyal, Bipin · Article author These are credits stated by the source; they do not establish a profile match or authorship of every passage. ## Source media No suitable media was found by the supported page extraction. ## Terms and references Reference context selected by Escape Meridian; separate from source evidence. Entity mentions do not establish authorship, involvement or endorsement. ## Foundation model A large model trained on broad data that can be adapted to many different tasks. - [Definition reference](https://developers.google.com/machine-learning/glossary#foundation-model) ## Model tokens Small chunks of text, often parts of words, that a language model reads and writes; usage and prices are often counted in tokens. - [Definition reference](https://developers.google.com/machine-learning/glossary#token) ## Zero-shot Doing a task without worked examples (zero-shot) or with only a few examples given in the prompt (few-shot). - [Definition reference](https://developers.google.com/machine-learning/glossary#zero-shot-prompting) ## Fine-tuning Further training of an existing model to adapt it to a particular task or use. - [Definition reference](https://developers.google.com/machine-learning/glossary#fine-tuning) ## arXiv arXiv is a research manuscript repository where authors share papers that may not yet have been peer reviewed. - [Explore this context](/entities/arxiv) - [Reference](https://arxiv.org/) - [Reference](https://info.arxiv.org/help/api/index.html) ## Editorial provenance Version 1. Publication ID: fad50c56-9361-4c45-8a45-4c52ab1b7bcc. Prepared by gpt-6-luna; grounding review by gpt-6-luna. Source check: uncertain by anthropic/claude-opus-5.5 on 2026-11-12T00:02:03.465Z. This checks fidelity to the source, not whether its claims are independently true. Editorial selection: accept; reasons: material\_development. Observation: bfe644637d6b5df2a23f8c4ef722f2509fa6cf95470a00f1dca3d2384dad3727. Source text hash: cae6b1d537b289ee5fa8cf568b08d8b6d2e8bce18ed83ca7abd78a44db66d6b2. ### uncertain — 2026-11-12T00:02:03.465Z — anthropic/claude-opus-5.5 Publication: fad50c56-9361-4c45-8a45-4c52ab1b7bcc attribution — pass: The draft names the five listed authors and attributes the methods, results and FLEURS conclusion to them as reported findings. The title correctly identifies the arXiv cs.AI listing. > Authors:Jeevan Neupane, Janardan Bhetwal, Kshitiz Paudel, Anup Aryal, Bipin Bashyal summary — uncertain: The draft is faithful, but a non-specialist cannot follow it. It never says SraVaani is a speech recognition foundation model. Tokenizer, zero-shot ASR, fine-tuning, freezing the encoder, FLEURS and out-of-domain are not explained. The draft also omits the abstract's second problem: recognisers struggle with the writing script used for English words. Without that, the FLEURS mixed-script comparison is opaque. Smallest repair: one plain sentence on what SraVaani is and why script and numbers cause trouble, plus tooltip entries for the remaining terms. The title simply repeats the paper title and does not state what changed. > multilingual speech recognisers often struggle with language switches and the writing script used for English words date — pass: originalPublished 2026-11-10 matches the arXiv v1 submission date. The feed date of 2026-11-11 is later and is correctly not used. > \[Submitted on 10 Nov 2026\] support — uncertain: All numeric claims match the abstract. The draft adds: 'These results make the handling of number-containing speech central to their approach, rather than an incidental data-cleaning choice.' This is unlabeled interpretation. The abstract shows only that excluding numeric clips raises WER on numeric test speech; it does not show that the approach is centrally driven by number handling overall. That sentence should be labeled as Escape Meridian interpretation and narrowed to the numeric-test result, or removed. The FLEURS question is legitimate because the abstract leaves the size of the contribution unquantified. > excluding numeric clips raises WER on numeric test speech from 14.3% to 21.3% media — pass: The selected media is the verified direct arXiv abstract page for this paper, which is the most direct access to the source. ## Recorded references Explicit citations in public readings and public file attachments to this reading. Shared topics are not citations. Other artifact types need an explicit reference adapter. No public references recorded here yet. [Reference data (JSON)](/readings/6fcabb147aef9add876080231a689a895e8b0f71e26fbc7713556d5b32c2770f/references.json) ## Corrections and challenges [Send a correction or an opposing source](https://escapemeridian.com/corrections/) [JSON record](https://escapemeridian.com/readings/arxiv-cs-ai-nepali-english-code-mixed-speech-recognition-data-6fcabb14.json)