Shall We Pretrain Autoregressive Language Models with Retrieval? A Comprehensive Study
Boxin Wang, Wei Ping, Peng Xu, Lawrence McAfee, Zihan Liu, Mohammad Shoeybi, Yi Dong, Oleksii Kuchaiev, Bo Li, Chaowei Xiao, Anima Anandkumar, Bryan Catanzaro
Main: Theme Track: Large Language Models and the Future of NLP Main-poster Paper
Poster_Demo_Industry_Findings In-person 4: Theme Track: Large Language Models and the Future of NLP (Poster)
Conference Room: East Foyer
Conference Time: December 09, 09:00-10:30 (+08) (Asia/Singapore)
Global Time: December 09, Poster_Demo_Industry_Findings In-person 4 (01:00-02:30 UTC)
TLDR:
You can open the
#paper-2937
channel in a separate window.
Abstract: