Ensemble Routing for Prompt-Adaptive Cost-Aware LLM Inference

媒体报道 Hugging Face Papers 原文语言:中文

原文摘录

论文摘要(作者报告,未经本站复测):Large language models (LLMs) increasingly support Web-based services that must balance response quality and inference cost across heterogeneous requests. Conventional routing selects one model per prompt, while fixed ensembles cannot adapt their composition and cost to individual requests.

以下是来源提供的简短摘录,完整内容请查看原文。

参考来源

← 返回每日AI报告