litellm

History

Yikai Zhao 4fdeff8e1a Fix token_counter with special token input		2025-08-07 22:58:07 +08:00
..
basic_proxy_startup_tests
batches_tests	openai.ConflictError	2025-07-12 17:07:21 -07:00
code_coverage_tests	Fix - using managed files w/ OTEL + UI - add model group alias on UI (#13171 )	2025-07-31 21:22:04 -07:00
documentation_tests
enterprise	[Feat] - When using custom tags on prometheus allow using wildcard patterns (#13316 )	2025-08-05 17:46:13 -07:00
guardrails_tests	feat: Add Pillar Security guardrail integration (#12791 )	2025-07-22 23:17:33 -07:00
image_gen_tests	[Feat] Add Google AI Studio Imagen4 model family (#13065 )	2025-07-28 21:25:40 -07:00
litellm_utils_tests	test: update test	2025-07-29 21:08:36 -07:00
litellm-proxy-extras
llm_responses_api_testing	Bug Fix - Responses API raises error with Gemini Tool Calls in `input` (#13260 )	2025-08-04 12:01:33 -07:00
llm_translation	test_function_calling_with_tool_response	2025-08-05 09:55:47 -07:00
load_tests
local_testing	vtx test fix gemini-2.5-flash-lite	2025-08-07 00:11:10 -07:00
logging_callback_tests	[Feat] Allow redacting message / response content for specific logging integrations - DD LLM Observability (#13158 )	2025-07-31 16:44:16 -07:00
mcp_tests	[MCP Gateway] fix auth on ui for bearer servers (#13312 )	2025-08-06 09:46:10 -07:00
multi_instance_e2e_tests
old_proxy_tests/tests
openai_endpoints_tests	Batches - support batch retrieve with target model Query Param + Anthropic - completion bridge, yield content_block_stop chunk (#12228 )	2025-07-01 22:13:48 -07:00
otel_tests	test_bedrock_guardrail_triggered	2025-07-09 17:05:06 -07:00
pass_through_tests	test_anthropic_basic_completion_with_headers ci/cd fix	2025-07-12 11:08:03 -07:00
pass_through_unit_tests	Azure `api_version="preview"` support + Bedrock cost tracking via Anthropic `/v1/messages` (#13072 )	2025-07-29 08:13:55 -07:00
proxy_admin_ui_tests	Fix e2e test (#12549 )	2025-07-12 10:42:57 -07:00
proxy_security_tests
proxy_unit_tests	Exclude none fields on `/chat/completion` - fixes n8n bug + Allow calling `/v1/models` when end user over budget (#13320 )	2025-08-05 21:39:46 -07:00
router_unit_tests	[LLM Translation] Fix model group on clientside auth with API calls (#13314 )	2025-08-05 17:46:47 -07:00
scim_tests
spend_tracking_tests
store_model_in_db_tests	[MCP Gateway] fix auth on ui for bearer servers (#13312 )	2025-08-06 09:46:10 -07:00
test_litellm	Fix token_counter with special token input	2025-08-07 22:58:07 +08:00
unified_google_tests	test fix: gcp deprecated gemini-1.5-flash	2025-08-06 08:43:45 -07:00
vector_store_tests	[Feat] UI Vector Stores - Allow adding Vertex RAG Engine, OpenAI, Azure (#12752 )	2025-07-18 18:25:26 -07:00
windows_tests
__init__.py	[Feat] Add github co-pilot as a new LLM API provider (#12325 )	2025-07-04 13:12:16 -07:00
gettysburg.wav
large_text.py
openai_batch_completions.jsonl
README.MD
test_budget_management.py
test_callbacks_on_proxy.py
test_config.py
test_debug_warning.py
test_end_users.py
test_entrypoint.py
test_fallbacks.py
test_health.py
test_keys.py
test_logging.conf
test_models.py
test_openai_endpoints.py	test_chat_completion_ratelimit	2025-07-30 23:12:11 -07:00
test_organizations.py
test_passthrough_endpoints.py
test_ratelimit.py
test_resource_cleanup.py	Fix: Properly close aiohttp client sessions to prevent resource leaks (#12251 )	2025-07-09 09:25:17 -07:00
test_spend_logs.py
test_team_logging.py
test_team_members.py
test_team.py
test_users.py

README.MD

In total litellm runs 1000+ tests

[02/20/2025] Update:

To make it easier to contribute and map what behavior is tested,

we've started mapping the litellm directory in tests/litellm

This folder can only run mock tests.