sefazeng / tupe Goto Github PK
View Code? Open in Web Editor NEWThis project forked from guolinke/tupe
Transformer with Untied Positional Encoding (TUPE). Code of paper "Rethinking Positional Encoding in Language Pre-training". Improve existing models like BERT.
License: MIT License