Cache me if you Can: an Online Cost-aware Teacher-Student framework to Reduce the Calls to Large Language Models

Ilias Stogiannidis, Stavros Vassos, Prodromos Malakasiotis, Ion Androutsopoulos

Findings: NLP Applications Findings Paper

Poster_Demo_Industry_Findings In-person 7: NLP Applications (Poster)
Conference Room: East Foyer
Conference Time: December 10, 11:00-12:30 (+08) (Asia/Singapore)
Global Time: December 10, Poster_Demo_Industry_Findings In-person 7 (03:00-04:30 UTC)
TLDR:
You can open the #paper-3192 channel in a separate window.
Abstract: