Generalize model backends and default to Gemini 3.5 Flash#102
Open
eshulman2 wants to merge 3 commits into
Open
Generalize model backends and default to Gemini 3.5 Flash#102eshulman2 wants to merge 3 commits into
eshulman2 wants to merge 3 commits into
Conversation
71c15ba to
1f70e48
Compare
faffad0 to
16f5912
Compare
e9624a4 to
2fa773b
Compare
2fa773b to
ab578b4
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Make Forge provider-neutral at the product layer and use Gemini 3.5 Flash on Vertex AI as the default model backend.
Changes
LLM_BACKENDselection:vertex-ai,google-genai, oranthropicvertex-aiwithgemini-3.5-flashGOOGLE_CLOUD_PROJECT/GOOGLE_CLOUD_LOCATIONplus ADC for Vertex AIGOOGLE_API_KEYfor the Gemini APIANTHROPIC_API_KEYfor the Anthropic APILLM_API_KEY,VERTEX_*, andANTHROPIC_VERTEX_*aliases workingLLM_BACKENDDefault configuration
Vertex AI uses Application Default Credentials.
Validation
uv run ruff check src/forge containers/entrypoint.pyuv run ruff format --check src/ containers/entrypoint.pyCompatibility
Existing deployments using only
ANTHROPIC_API_KEYcontinue on the Anthropic backend with the prior direct-compatible model ID. Existing legacy Vertex project variables continue to select Vertex AI.GOOGLE_API_KEYwithout an explicit backend selects the Gemini API. New deployments default to Gemini 3.5 Flash on Vertex AI.