Spaces:

---

huggingface

/

HuggingDiscussions

like 91

Running

Love that I can call DeepSeek R1 directly from the Hub 🔥

from huggingface_hub import InferenceClient

client = InferenceClient(
    provider="together",
    api_key="xxxxxxxxxxxxxxxxxxxxxxxx"
)

messages = [
    {
        "role": "user",
        "content": "What is the capital of France?"
    }
]

completion = client.chat.completions.create(
    model="deepseek-ai/DeepSeek-R1", 
    messages=messages, 
    max_tokens=500
)

print(completion.choices[0].message)

Is it possible to set a monthly payment budget or rate limits for all the external providers? I don't see such options in billings tab. In case a key is or session token is stolen, it can be quite dangerous to my thin wallet:(

@benhaotang you already get spending notifications when crossing important thresholds ($10, $100, $1,000) but we'll add spending limits in the future

@benhaotang you already get spending notifications when crossing important thresholds ($10, $100, $1,000) but we'll add spending limits in the future

Thanks for your quick reply, good to know!

Would be great if you could add Nebius AI Studio to the list :) New inference provider on the market, with the absolute cheapest prices and the highest rate limits...

Could be good to add featherless.ai

TitanML !!

New Inference Provider — GonkaBroker (gonkabroker)

Hi! We'd like to be listed as an Inference Provider. We route to the Gonka.ai decentralized inference network via an OpenAI-compatible API.

• Org / provider slug: gonkabroker (Team plan active)
• JS client PR: https://github.com/huggingface/huggingface.js/pull/2226 (conversational + text-generation)
• Base URL: https://proxy.gonkabroker.com (/v1/chat/completions, /v1/completions, /v1/models)
• /v1/models exposes per-model pricing (USD/M) + context length for the comparison table / :cheapest.
• Billing API: POST https://app.gonkabroker.com/api/partners/huggingface/billing, Bearer auth, {"requestIds":[...]} → {"requests":[{"requestId","costNanoUsd"}]} (nano-USD).
• Request ID header: Inference-Id on every response.
• Logo (light + dark) ready to send.

Could you enable the org server-side so we can register model mappings? Happy to share the master key for routed traffic over a private channel. Thanks!

Following up on the GonkaBroker provider request above — the JS PR is open and ready for review: https://github.com/huggingface/huggingface.js/pull/2226 (CI awaiting maintainer approval to run). Paid Team plan active, all prerequisites done. Would love help getting it moving.

New Inference Provider integration — deAPI

Hi HF team 👋

We're deAPI (https://deapi.ai, HF org: https://huggingface.co/deAPI-ai) and we'd like to register as an official Inference Provider on the Hub.

deAPI provides an OpenAI-compatible inference API at:

https://oai.deapi.ai/v1

with Bearer token authentication. The endpoint works with the official OpenAI SDK by changing the base_url, and we also maintain a native Python SDK for deAPI workflows.

For the initial integration, we'd like to start with image, audio and embedding tasks:

• text-to-image

  • FLUX.2 Klein 4B BF16
  • Z-Anime
  • Z-Image-Turbo INT8
  • FLUX.1 schnell

• image-to-image

  • FLUX.2 Klein 4B BF16
  • Qwen Image Edit Plus

• automatic-speech-recognition

  • Whisper Large V3

• text-to-speech

  • Qwen3 TTS CustomVoice
  • Qwen3 TTS VoiceDesign
  • Qwen3 TTS VoiceClone
  • Chatterbox
  • Kokoro

• feature-extraction / embeddings

  • BGE M3

Exact model slugs, limits and defaults can be resolved through our Model Selection endpoint during the mapping setup.

LLM/chat models are also on our near-term roadmap, and we expect to add conversational / text-generation support shortly after the initial provider setup is live.

We've read the “register as a provider” guide and have already opened the following huggingface.js PR:

https://github.com/huggingface/huggingface.js/pull/2240

The PR starts with text-to-image on a single model in staging. We're also adding a per-response correlation header using Inference-Id with a UUID value, so it can support routed billing and request reconciliation.

One clarification on plan requirements before we finalize the setup. We understand a Team/Enterprise org plan is needed for the Model Mapping API (the routed path). Is the same plan required for a custom-key-only listing (clientSideRoutingOnly, like OpenAI) — where users add their own deAPI key and we bill them directly? We’re considering starting custom-key-only and adding routed billing (dedicated key + reconciliation) in a later phase, so we’d like to understand the plan prerequisites for each path. Thanks!

Happy to continue here or by email if that works better. Thanks!

Request to become an Inference Provider: Umans AI (GLM 5.2 + Kimi K2.7-Code)

Hi HF team 👋

We'd like to list Umans AI as an Inference Provider. We serve open-weight models on our own infrastructure, starting with:

• zai-org/GLM-5.2
• moonshot/kimi-k2.7-code (Kimi K2.7-Code)

On our side:

• HF org umans-ai is on the Team plan.
• We expose an OpenAI-compatible API (/v1/chat/completions, and /v1/models already serving pricing + context_length), which is the surface HF integrates with, plus an Anthropic Messages-compatible API (/v1/messages).
• We've implemented the billing callback (it maps each request id to its cost in nano-USD) and emit a unique Inference-Id response header, per the provider docs.
• Ready to open the huggingface.js provider PR and register model mappings as soon as our org is enabled server-side.

Could you point us to the next step to enable the org for the Model Mapping API, and the right contact for the commercial/payout setup?

Public API base: https://api.code.umans.ai
Contact: contact@umans.ai

Thanks!

Hi HF team 👋 We'd love to be added as an inference provider: Public AI (TEE).

We serve confidential LLM inference inside hardware TEEs via an OpenAI-compatible endpoint. We've already followed the register-as-a-provider guide:

• Provider id: publicai-tee · Org (Team plan): https://huggingface.co/publicai-tee
• JS integration PR: huggingface/huggingface.js#2252
• Endpoint verified OpenAI-compatible (chat completions + streaming); first model MiniMaxAI/MiniMax-M3

Could you please enable publicai-tee server-side so we can proceed with the Model Mapping API? Happy to share anything else you need. Thanks! 🙏

Hi HF team. We'd love to be added as an inference provider: SCX AI.

We serve sovereign, onshore LLM inference via an OpenAI-compatible endpoint (https://api.scx.ai/v1). We've already followed the register-as-a-provider guide:

Provider id: scx-ai · Org (Team plan): https://huggingface.co/SCXai
JS integration PR: huggingface/huggingface.js#2286
Endpoint verified OpenAI-compatible — chat completions + streaming, plus audio transcriptions (Whisper).

Models:

• MiniMaxAI/MiniMax-M2.7 (conversational, tool calling)
• openai/gpt-oss-120b (conversational, tool calling)
• meta-llama/Llama-4-Maverick-17B-128E-Instruct (conversational, vision)
• google/gemma-4-31B-it (conversational, vision + video-in)
• Qwen/Qwen3-32B (conversational, tool calling)
• openai/whisper-large-v3 (automatic-speech-recognition)

Could you please enable scx-ai server-side so we can proceed with the Model Mapping API? Happy to share anything else you need. Thanks.

Hi, I am Jonah, from Kalanda SAS. We have been a web hosting company for 25 years, and we've recently expanded into AI infrastructure, running production inference on our own DC in France, including open-weight models. We would like to register as an Inference Provider on the Hugging Face Hub. Could you please point us to the next steps, or connect us with the right person to discuss requirements?
Thanks,
Jonah - www.kalanda.net