跳到主要内容

Featherless AI

https://featherless.ai/

提示

我们支持所有 Featherless AI 模型，只需在发送 litellm 请求时设置 model=featherless_ai/<any-model-on-featherless> 作为前缀。如需完整的支持模型列表，请访问 https://featherless.ai/models

API Key​

# env variable
os.environ['FEATHERLESS_AI_API_KEY']

示例用法​

from litellm import completion
import os

os.environ['FEATHERLESS_AI_API_KEY'] = ""
response = completion(
    model="featherless_ai/featherless-ai/Qwerky-72B", 
    messages=[{"role": "user", "content": "write code for saying hi from LiteLLM"}]
)

示例用法 - 流式传输​

from litellm import completion
import os

os.environ['FEATHERLESS_AI_API_KEY'] = ""
response = completion(
    model="featherless_ai/featherless-ai/Qwerky-72B", 
    messages=[{"role": "user", "content": "write code for saying hi from LiteLLM"}],
    stream=True
)

for chunk in response:
    print(chunk)

聊天模型​

模型名称函数调用
featherless-ai/Qwerky-72Bcompletion(model="featherless_ai/featherless-ai/Qwerky-72B", messages)
featherless-ai/Qwerky-QwQ-32Bcompletion(model="featherless_ai/featherless-ai/Qwerky-QwQ-32B", messages)
Qwen/Qwen2.5-72B-Instructcompletion(model="featherless_ai/Qwen/Qwen2.5-72B-Instruct", messages)
all-hands/openhands-lm-32b-v0.1completion(model="featherless_ai/all-hands/openhands-lm-32b-v0.1", messages)
Qwen/Qwen2.5-Coder-32B-Instructcompletion(model="featherless_ai/Qwen/Qwen2.5-Coder-32B-Instruct", messages)
deepseek-ai/DeepSeek-V3-0324completion(model="featherless_ai/deepseek-ai/DeepSeek-V3-0324", messages)
mistralai/Mistral-Small-24B-Instruct-2501completion(model="featherless_ai/mistralai/Mistral-Small-24B-Instruct-2501", messages)
mistralai/Mistral-Nemo-Instruct-2407completion(model="featherless_ai/mistralai/Mistral-Nemo-Instruct-2407", messages)
ProdeusUnity/Stellar-Odyssey-12b-v0.0completion(model="featherless_ai/ProdeusUnity/Stellar-Odyssey-12b-v0.0", messages)