Pretraining Without Attention

Junxiong Wang, Jing Nathan Yan, Albert Gu, Alexander M Rush

Findings: Machine Learning for NLP Findings Paper

Poster_Demo_Industry_Findings Virtual 7: Machine Learning for NLP (Poster)
Conference Room: Virtual-Gathertown
Conference Time: December 10, 11:00-12:30 (+08) (Asia/Singapore)
Global Time: December 10, Poster_Demo_Industry_Findings Virtual 7 (03:00-04:30 UTC)
TLDR:
You can open the #paper-ARR-125 channel in a separate window.
Abstract: