litellm/tests
Ishaan Jaff f6d7683261
[Feat] LiteLLM Overhead metric tracking - Add support for tracking litellm overhead on cache hits (#15045)
* test_litellm_overhead

* vertex track overhead

* fix config.yaml used for testing

* test_litellm_overhead_stream

* add update_response_metadata for caching handler

* add CachingDetails

* fix update_response_metadata import

* add CachingDetails metrics

* add CachingDetails

* test_litellm_overhead_cache_hit

* test_litellm_overhead_cache_hit

* test_litellm_overhead_cache_hit
2025-09-29 17:33:27 -07:00
..
basic_proxy_startup_tests
batches_tests
code_coverage_tests fix fastuuid 2025-09-26 18:20:32 -07:00
documentation_tests
enterprise test fix 2025-09-27 12:40:34 -07:00
guardrails_tests fix: reject status code and tests. 2025-09-28 16:56:28 +05:30
image_gen_tests fix bedrock end of life img gen models 2025-09-27 17:02:48 -07:00
litellm/llms
litellm_utils_tests [Feat] LiteLLM Overhead metric tracking - Add support for tracking litellm overhead on cache hits (#15045) 2025-09-29 17:33:27 -07:00
litellm-proxy-extras
llm_responses_api_testing fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
llm_translation test_completion_azure 2025-09-27 22:44:46 -07:00
load_tests
local_testing fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency (#15046) 2025-09-29 15:49:46 -07:00
logging_callback_tests test: update test 2025-09-27 16:30:52 -07:00
mcp_tests test: fix tests 2025-09-29 07:21:32 +09:00
multi_instance_e2e_tests fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
old_proxy_tests/tests test fix 2025-09-27 12:40:34 -07:00
openai_endpoints_tests
otel_tests fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
pass_through_tests fix passthru tests 2025-09-27 14:24:55 -07:00
pass_through_unit_tests
proxy_admin_ui_tests fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
proxy_security_tests
proxy_unit_tests test_gemini_pass_through_endpoint 2025-09-27 17:17:12 -07:00
router_unit_tests fix: remove router inefficiencies (from O(M*N) to O(1)) - 62.5% faster P99 latency (#15046) 2025-09-29 15:49:46 -07:00
scim_tests
spend_tracking_tests fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
store_model_in_db_tests fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_litellm Revert "test_keyslot_for_redis_cluster" 2025-09-29 16:42:15 -07:00
unified_google_tests
vector_store_tests fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
windows_tests
__init__.py
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_callbacks_on_proxy.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_config.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_debug_warning.py
test_end_users.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_entrypoint.py
test_fallbacks.py
test_health.py
test_keys.py
test_logging.conf
test_models.py test_add_model_run_health 2025-09-27 10:59:25 -07:00
test_openai_endpoints.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py
test_spend_logs.py
test_team_logging.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_team_members.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00
test_team.py
test_users.py fix: use fastuuid helper (#14903) 2025-09-25 15:47:01 -07:00

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.