Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add icefall RNN-T results #113

Merged
merged 2 commits into from
May 17, 2022
Merged

Add icefall RNN-T results #113

merged 2 commits into from
May 17, 2022

Conversation

wgb14
Copy link
Collaborator

@wgb14 wgb14 commented May 13, 2022

We would like to add results from Icefall RNN-T recipe. The numbers are comparable to those form Conformer CTC with ngram & attention rescoring, but decoding speed is much faster.

it takes only 1 minute to decode the dev dataset

k2-fsa/icefall#318 (comment)

@wgb14 wgb14 requested review from chenguoguo and dophist May 13, 2022 04:51
@wgb14 wgb14 changed the title Add icefall RNN-T results WIP: Add icefall RNN-T results May 13, 2022
@csukuangfj
Copy link

k2-fsa/icefall#361 has an updated version for the results of modified beam serach

10.52/10.62 -> 10.50/10.60

@chenguoguo
Copy link
Collaborator

Great, great, could you adjust the numbers, and rank it accordingly?

@wgb14
Copy link
Collaborator Author

wgb14 commented May 13, 2022

Will do more decoding experiments and update results here

@csukuangfj
Copy link

Will do more decoding experiments and update results here

You can also try --iter xx --avg xx instead of --epoch xx --avg xx.

@wgb14
Copy link
Collaborator Author

wgb14 commented May 15, 2022

Update results here:

Dev Test
WER 10.4 10.51

This RNN-T model outperforms other models.

@wgb14 wgb14 changed the title WIP: Add icefall RNN-T results Add icefall RNN-T results May 15, 2022
Copy link
Collaborator

@dophist dophist left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@wgb14 Great

@chenguoguo
Copy link
Collaborator

Great, merging.

@chenguoguo chenguoguo merged commit cdf3a93 into main May 17, 2022
@wgb14 wgb14 deleted the Leaderboard_Icefall_RNN-T branch May 17, 2022 05:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants