Posted on April 30, 2020
| Back to Showreel
Investigating Transferability in Pretrained Language Models
This is mostly a useful and interesting technical result around what is the best way to do transfer-learning when working with NLP models. The point is, in different data size regimes, you should do different things, to achieve the best results.
