5e34fdce77
* feat(vertex_ai): support explicit AWS credentials for WIF auth The current Vertex AI AWS Workload Identity Federation implementation exclusively uses google.auth.aws.Credentials.from_info(), which requires EC2 instance metadata access to obtain AWS credentials. In environments where the metadata service is blocked for security reasons, this makes WIF unusable. Add support for explicit AWS credentials by implementing a custom AwsSecurityCredentialsSupplier (google-auth >= 2.29.0). When aws_* keys (e.g. aws_role_name, aws_region_name) are present in the WIF credential JSON, LiteLLM uses BaseAWSLLM.get_credentials() to obtain AWS creds via STS AssumeRole (or any other supported AWS auth flow), wraps them in the custom supplier, and passes them to aws.Credentials() — bypassing the metadata service entirely. When no aws_* keys are present, the existing from_info() flow is used unchanged, preserving full backward compatibility. * refactor(vertex_ai): extract AWS WIF auth to own class + add docs Address PR review feedback: - Move _AWS_CREDENTIAL_KEYS, _extract_aws_params(), and _credentials_from_aws_with_explicit_auth() from VertexBase into new VertexAIAwsWifAuth class in vertex_ai_aws_wif.py - Add documentation for explicit AWS credentials WIF auth method in vertex.md (supported params, JSON example, SDK/Proxy tabs) Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com> * fix(vertex_ai): use lazy credentials provider to prevent stale STS tokens --------- Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com> |
||
|---|---|---|
| .. | ||
| agent_tests | ||
| audio_tests | ||
| basic_proxy_startup_tests | ||
| batches_tests | ||
| code_coverage_tests | ||
| documentation_tests | ||
| enterprise | ||
| guardrails_tests | ||
| image_gen_tests | ||
| litellm | ||
| litellm_core_utils | ||
| litellm_utils_tests | ||
| litellm-proxy-extras | ||
| llm_responses_api_testing | ||
| llm_translation | ||
| load_tests | ||
| local_testing | ||
| logging_callback_tests | ||
| mcp_tests | ||
| multi_instance_e2e_tests | ||
| ocr_tests | ||
| old_proxy_tests/tests | ||
| openai_endpoints_tests | ||
| otel_tests | ||
| pass_through_tests | ||
| pass_through_unit_tests | ||
| proxy_admin_ui_tests | ||
| proxy_e2e_anthropic_messages_tests | ||
| proxy_e2e_azure_batches_tests | ||
| proxy_security_tests | ||
| proxy_unit_tests | ||
| router_unit_tests | ||
| scim_tests | ||
| search_tests | ||
| spend_tracking_tests | ||
| store_model_in_db_tests | ||
| test_litellm | ||
| unified_google_tests | ||
| vector_store_tests | ||
| windows_tests | ||
| __init__.py | ||
| gettysburg.wav | ||
| large_text.py | ||
| openai_batch_completions.jsonl | ||
| README.MD | ||
| test_budget_management.py | ||
| test_callbacks_on_proxy.py | ||
| test_config.py | ||
| test_debug_warning.py | ||
| test_default_encoding_non_root.py | ||
| test_end_users.py | ||
| test_entrypoint.py | ||
| test_fallbacks.py | ||
| test_gpt5_azure_temperature_support.py | ||
| test_health.py | ||
| test_keys.py | ||
| test_litellm_proxy_responses_config.py | ||
| test_logging.conf | ||
| test_models.py | ||
| test_openai_endpoints.py | ||
| test_organizations.py | ||
| test_otel_thread_leak.py | ||
| test_passthrough_endpoints.py | ||
| test_presidio_latency.py | ||
| test_proxy_server_non_root.py | ||
| test_ratelimit.py | ||
| test_resource_cleanup.py | ||
| test_service_logger_otel.py | ||
| test_spend_logs.py | ||
| test_team_logging.py | ||
| test_team_members.py | ||
| test_team.py | ||
| test_users.py | ||
In total litellm runs 1000+ tests
[02/20/2025] Update:
To make it easier to contribute and map what behavior is tested,
we've started mapping the litellm directory in tests/test_litellm
This folder can only run mock tests.