litellm/tests/test_litellm/llms
Mateo Wang 49ca04d8c3
feat(bedrock): aws_bedrock_project_id for bedrock-mantle project / workspace association (#30163)
* feat(bedrock): support aws_bedrock_project_id for bedrock-mantle project association

Adds a litellm_params field to associate bedrock-mantle requests with an
Amazon Bedrock project, sent as the OpenAI-Project header on the
OpenAI-compatible chat and responses paths and as the anthropic-workspace
header on the Anthropic messages paths. This lets a single model entry opt
into a project-scoped data retention mode (e.g. provider_data_share for
Claude Fable 5) while the account-wide setting stays on default.

The param is carried via litellm_params only and is explicitly excluded
from optional_params so it can never leak into a request body.

Fixes #30070

* chore(ui): regenerate schema.d.ts for aws_bedrock_project_id

Generated with npm run gen:api after adding the field to LiteLLM_Params

* fix(proxy): ban client-supplied aws_bedrock_project_id in request bodies

The deployment pins aws_bedrock_project_id so the project's data
retention policy applies to its requests. Without this guard an
authenticated caller could supply the field in the request body and,
since client kwargs win the router merge, run requests under any
project reachable with the deployment's shared AWS credentials.

Adds the field to _BANNED_REQUEST_BODY_PARAMS so it is rejected at the
auth boundary by default while remaining available through the existing
admin opt-ins (allow_client_side_credentials proxy-wide or
configurable_clientside_auth_params per deployment).
2026-06-11 10:01:08 +05:30
..
amazon_nova/chat
anthropic fix: completion_cost AttributeError on streaming Anthropic web_search responses (#26153) (#27346) 2026-06-10 21:20:11 -07:00
apiserpent Litellm oss staging (#29492) 2026-06-02 08:48:10 -07:00
azure feat(azure_ai): add MAI-Image-2.5 image generation support (#29688) 2026-06-08 18:27:04 -07:00
azure_ai feat(azure_ai): add MAI-Image-2.5 image generation support (#29688) 2026-06-08 18:27:04 -07:00
base_llm fix(team): keep team_alias cache in sync on _cache_team_object writes (#28737) 2026-05-25 19:16:36 -07:00
baseten/chat
bedrock feat(bedrock): aws_bedrock_project_id for bedrock-mantle project / workspace association (#30163) 2026-06-11 10:01:08 +05:30
bedrock_mantle feat(bedrock): aws_bedrock_project_id for bedrock-mantle project / workspace association (#30163) 2026-06-11 10:01:08 +05:30
black_forest_labs Litellm OSS Staging 010626 (#29422) 2026-06-01 21:42:51 -07:00
bytez/chat
chat
chatgpt Litellm oss staging 04 21 2026 2 (#26569) 2026-05-20 21:25:19 -07:00
cloudflare
cohere Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
cometapi/chat
compactifai
crusoe
custom_httpx Litellm oss staging 080626 (#29932) 2026-06-08 13:49:52 -07:00
dashscope Litellm oss staging (#28161) 2026-05-18 16:27:44 -07:00
databricks [internal copy of #28007] Fix/gcp model garden streaming (#28363) 2026-06-10 12:31:00 -07:00
datarobot
deepgram
deepinfra
deepseek fix(deepseek): use native /anthropic/v1/messages endpoint and sanitize tools (#28200) 2026-05-18 18:14:13 -07:00
docker_model_runner
elevenlabs
fal_ai/image_generation feat(fal_ai): add Nano Banana / Gemini 2.5 Flash Image generation support (#29798) 2026-06-06 11:16:44 -07:00
featherless_ai/chat
fireworks_ai fix(fireworks): enable tool calling for glm-5p1 in model cost map (#29697) 2026-06-08 15:54:19 -07:00
gemini Litellm oss staging 080626 (#29932) 2026-06-08 13:49:52 -07:00
github_copilot Litellm oss staging 080626 (#29932) 2026-06-08 13:49:52 -07:00
heroku
hosted_vllm fix(hosted_vllm): normalize custom tools for chat completions (#25763) 2026-05-05 17:27:02 -07:00
huggingface Litellm oss staging 040626 (#29671) 2026-06-04 11:07:20 -07:00
inception Litellm oss staging 030626 (#29578) 2026-06-03 11:01:51 -07:00
jina_ai/embedding
langflow feat(agents): add LangFlow agent provider with A2A session bridging (#28963) 2026-06-02 14:45:56 -07:00
lemonade Litellm OSS Staging (#29161) 2026-06-01 21:22:35 -07:00
litellm_proxy chore: simplify ownership tracking — drop thin stores, in-memory fallback, hand-rolled cache 2026-05-05 00:23:32 +00:00
llamafile/chat
lm_studio
manus
meta_llama
minimax
mistral
moonshot Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
nebius
neosantara Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
novita/chat
nscale/chat
nvidia_riva feat(audio_transcription): add NVIDIA Riva STT provider (#27185) 2026-05-05 17:17:51 -07:00
oci CI: copy of #25177 (OCI GenAI: embeddings, streaming/reasoning fixes, model catalog) (#28223) 2026-05-23 12:15:41 -07:00
ocr
ollama Litellm OSS Staging (#29161) 2026-06-01 21:22:35 -07:00
openai Litellm oss 090626 (#30021) 2026-06-10 10:34:07 -07:00
openai_like Litellm oss 090626 (#30021) 2026-06-10 10:34:07 -07:00
openrouter
ovhcloud
parasail Litellm oss staging 080626 (#29932) 2026-06-08 13:49:52 -07:00
perplexity
pg_vector/vector_stores
publicai
ragflow/chat
recraft
reducto Litellm oss staging 04 21 2026 2 (#26569) 2026-05-20 21:25:19 -07:00
runwayml
s3_vectors
sagemaker fix(sagemaker): send native Cohere embed payload to Cohere SageMaker endpoints (#28613) 2026-05-22 12:00:42 -07:00
sambanova
sap
scaleway
snowflake
soniox Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
stability
vercel_ai_gateway
vertex_ai Litellm oss 090626 (#30021) 2026-06-10 10:34:07 -07:00
volcengine
voyage/rerank
wandb
watsonx Litellm OSS Staging 010626 (#29422) 2026-06-01 21:42:51 -07:00
xai Litellm oss 090626 (#30021) 2026-06-10 10:34:07 -07:00
you_com Litellm oss staging 050626 (#29774) 2026-06-05 13:51:51 -07:00
zai
test_cache_control_and_reasoning.py
test_file_content_block.py Litellm oss staging (#28161) 2026-05-18 16:27:44 -07:00
test_file_search_responses.py fix(tests): use canonical litellm_enterprise import path (#27699) 2026-05-12 12:32:57 -07:00
test_lifecycle_fix.py
test_oom_fixes.py
test_polling_url_origin_match.py
test_predibase_transformation.py