MTL-多任务学习实战03

Reference：https://github.com/emonosuke/emoASR
源码下载链接

Encoder

1. RNN
2. Transformer (Trf.) [Vaswani 2017]
3. Conformer (Cf.) [Gulati 2020]
   Decoder
4. CTC [Graves 2006]
5. RNN-Transducer (RNN-T) [Graves 2012]
6. LAS [Chan 2015]
7. Transformer (Trf.)
   LM
   RNNLM
8. Transformer LM
9. BERT [Devlin 2018]
10. ELECTRA [Clark 2020]
11. Phone-attentive ELECTRA (P-ELECTRA) [Futami 2021]
    Method
12. Rescoring
13. Shallow Fusion
14. Knowledge Distillation [Futami 2020]