はてなブックマーク

https://github.com/BerriAI/litellm Call 100+ LLMs using the OpenAI Input/Output Format​ Translate inputs to provider's completion, embedding, and image_generation endpoints Consistent output, text responses will always be available at ['choices'][0]['message']['content'] Retry/fallback logic across multiple deployments (e.g. Azure/OpenAI) - Router Track spend & set budgets per project LiteLLM Prox