OpenMeter - 基于用量的计费

OpenMeter 是一款用于 AI/云应用的开源基于用量的计费解决方案。它与 Stripe 集成，可实现轻松计费。

信息

我们希望了解如何改进回调功能！欢迎与 LiteLLM 创始人会面或加入我们的 Discord

快速入门

仅需 2 行代码，即可通过 OpenMeter 立即记录您所有提供商的响应

从 https://openmeter.cloud/meters 获取您的 OpenMeter API 密钥

litellm.callbacks = ["openmeter"] # logs cost + usage of successful calls to openmeter

SDK

# uv add openmeter 
import litellm
import os

# from https://openmeter.cloud
os.environ["OPENMETER_API_ENDPOINT"] = ""
os.environ["OPENMETER_API_KEY"] = ""

# LLM API Keys
os.environ['OPENAI_API_KEY']=""

# set openmeter as a callback, litellm will send the data to openmeter
litellm.callbacks = ["openmeter"] 
 
# openai call
response = litellm.completion(
  model="gpt-3.5-turbo",
  messages=[
    {"role": "user", "content": "Hi 👋 - i'm openai"}
  ]
)

代理

1. 添加到 Config.yaml

model_list:
- litellm_params:
    api_base: https://openai-function-calling-workers.tasslexyz.workers.dev/
    api_key: my-fake-key
    model: openai/my-fake-model
  model_name: fake-openai-endpoint

litellm_settings:
  callbacks: ["openmeter"] # 👈 KEY CHANGE

2. 启动 Proxy

litellm --config /path/to/config.yaml

3. 测试它！

curl --location 'http://0.0.0.0:4000/chat/completions' \
--header 'Content-Type: application/json' \
--data ' {
      "model": "fake-openai-endpoint",
      "messages": [
        {
          "role": "user",
          "content": "what llm are you"
        }
      ],
    }
'