[Inference Providers] drop the conversational tag requirement - #2750
Open
hanouticelina wants to merge 1 commit into
Open
[Inference Providers] drop the conversational tag requirement#2750hanouticelina wants to merge 1 commit into
hanouticelina wants to merge 1 commit into
Conversation
… docs Any model with pipeline tag text-generation or image-text-to-text can be registered as a chat-completion model; the model's tags are no longer consulted, and the legacy text-generation task is no longer accepted. Co-Authored-By: Claude Fable 5 <noreply@anthropic.com>
|
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
The Hub no longer requires the
conversationaltag to register a model as a chat-completion model for inference providers (internal PR: huggingface-internal/moon-landing#19696). New rule: any model with pipeline tagtext-generationorimage-text-to-textcan be registered asconversational— the registered mapping decides, not the model's tags — and the legacytext-generationinference task is no longer accepted at registration.This updates
register-as-a-provideraccordingly, and switches the "browse chat models" links fromother=conversationaltopipeline_tag=text-generationso models without the tag are included.Note
Low Risk
Docs-only updates to links and provider registration guidance; no runtime or API code changes in this repo.
Overview
Documentation now matches Hub behavior where chat-completion registration no longer depends on the
conversationalmodel tag—providers registertext-generationandimage-text-to-textmodels with taskconversational, and the mapping defines chat completion rather than requiring aconversationaltag on the model.register-as-a-provider.mdrewrites thechatCompletiontip and Model Mapping API notes: validation isconversationalfor those pipeline tags,taskequalspipeline_tagotherwise, and examples no longer imply tagging models as conversational.Browse links in
models-widgets.md,inference-providers/index.md, andintegrations/codex.mdswitch fromother=conversationaltopipeline_tag=text-generationso model lists include chat-capable models without the legacy tag.Reviewed by Cursor Bugbot for commit 8a42b91. Bugbot is set up for automated code reviews on this repo. Configure here.