RouteLLM: An Open-Source Framework for Cost-Effective LLM Routing | LMSYS OrgRouteLLM: An Open-Source Framework for Cost-Effective LLM Routingby: Isaac Ong*, Amjad Almahairi*, Vincent Wu, Wei-Lin Chiang, Tianhao Wu, Joseph E. Gonzalez, M Waleed Kadous, Ion Stoica, Jul 01, 2024 LLMs have demonstrated remarkable capabilities across a range of tasks, but there exists wide variation in their costs and capabilities, as seen from the plot of performance against cost in Figure 1.
