ai-workspace-services/litellm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
36,702 Commits 9 Branches 7 Tags 935 MiB
cd9c511df6
Commit Graph

58 Commits

Author SHA1 Message Date
Yuneng Jiang
43077af378
[Fix] Sync CircleCI dependency pins with requirements.txt 
CircleCI had stale version pins (e.g. boto3==1.36.0, aioboto3==13.4.0) that
conflict with requirements.txt (boto3==1.42.80, aioboto3==15.5.0), causing
uv resolution failures. Updated all mismatched pins across config.yml and
.circleci/requirements.txt to match requirements.txt as the source of truth.

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
 2026-04-01 11:27:44 -07:00
yuneng-jiang
53d704a1f1 [Fix] Add litellm-proxy-extras to CI requirements for prisma migrations 
PR #23257 made proxy startup fail if prisma migrate fails, which
exposed that litellm-proxy-extras was never installed in CI. The import
error was previously silently ignored. Unpinned so it always pulls the
latest version from PyPI.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
 2026-03-12 14:58:22 -07:00
Alexsander Hamir
c442fcd922
CI/CD: Increase retries and stabilize litellm_mapped_tests_core (#19826) 
* Fix PLR0915: Extract system message handling to reduce statement count

* fix mypy

* fix: add host_progress_callback parameter to mock_call_tool in test

The test_call_tool_without_broken_pipe_error was failing because the mock function did not accept the host_progress_callback keyword argument that the actual implementation passes to client.call_tool(). Updated the mock to accept this parameter to match the real implementation signature.

* fixing flaky tests around oidc and email

* Add documentation comment to test file

* add retry

* add dependency

* increase retry

---------

Co-authored-by: yuneng-jiang <yuneng.jiang@gmail.com>
 2026-01-26 17:00:18 -08:00
Yuta Saito
7d7b78a53d test: Pydantic version up 
mcp 1.25.0 depends on pydantic<3.0.0 and >=2.11.0
 2026-01-20 10:49:33 +09:00
Yuta Saito
b229410fb5 test: ci requirements mcp version up 2026-01-20 10:42:58 +09:00
Ishaan Jaff
607d517c01
Revert "Bump mcp from 1.10.1 to 1.23.0 in /.circleci (#17363)" (#17457) 
This reverts commit 462d423d86.
 2025-12-03 19:44:24 -08:00
dependabot[bot]
462d423d86
Bump mcp from 1.10.1 to 1.23.0 in /.circleci (#17363) 
Bumps [mcp](https://github.com/modelcontextprotocol/python-sdk) from 1.10.1 to 1.23.0.
- [Release notes](https://github.com/modelcontextprotocol/python-sdk/releases)
- [Changelog](https://github.com/modelcontextprotocol/python-sdk/blob/main/RELEASE.md)
- [Commits](https://github.com/modelcontextprotocol/python-sdk/compare/v1.10.1...v1.23.0)

---
updated-dependencies:
- dependency-name: mcp
  dependency-version: 1.23.0
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2025-12-03 15:19:34 -08:00
Ishaan Jaffer
1d0b25dfa0 fix mapped tests 2025-11-06 18:47:51 -08:00
Krish Dholakia
80440e11a7
Revert "Update MCP version from 1.10.1 to 1.20.0 (#16281)" (#16300) 
This reverts commit 34c12d0131.
 2025-11-05 18:42:34 -08:00
Guan Zheng Huang
34c12d0131
Update MCP version from 1.10.1 to 1.20.0 (#16281) 
* Update MCP version from 1.10.1 to 1.20.0

- Update mcp dependency: 1.10.1 -> 1.20.0 in requirements.txt, pyproject.toml, and CI config
- Update uvicorn dependency: 0.29.0 -> 0.31.1 (required by MCP 1.20.0)
- Update PyJWT constraint to support newer versions required by MCP
- Update all CI pipeline references to MCP 1.20.0
- Add test to verify MCP version and import compatibility

MCP 1.20.0 requires uvicorn >=0.31.1 and PyJWT >=2.10.1.
MCP package remains Python >=3.10 only (no change to version constraint).

* Update poetry.lock for MCP 1.20.0
 2025-11-05 18:34:28 -08:00
Ishaan Jaff
80d4cc1283
[Perf] Use fastuuid for fast UUID generations - 2.1x Faster (#13992) 
* use fastuuid

* add fastuuid

* add fastuuid==0.12.0
 2025-08-26 19:47:25 -07:00
Ishaan Jaff
76f1064229
[Bug Fix] litellm incompatible with newest release of openAI v1.100.0 (#13728) 
* fix imports OpenAI SDK

* ResponseText fixes

* fixes ResponseText

* fix imports

* catch AttributeError

* fix import

* use openai==1.100.1

* fix build from PIP

* fix lint test

* Print OpenAI version

* fix Install dependencies
 2025-08-18 18:26:17 -07:00
Ishaan Jaff
3905cee579 test fixes 2025-08-08 18:50:09 -07:00
Jugal D. Bhatt
29a8c583c2
added redis iam auth (#13275) 2025-08-05 10:56:34 -07:00
Ishaan Jaff
b8e404dd95
[Feat] Backend Router - Add Auto-Router powered by semantic-router (#12955) 
* add router.json

* test_router_auto_router

* async_pre_routing_hook

* fixes for auto router

* add async_pre_routing_hook

* add LiteLLMRouterEncoder

* update test auto_router_embedding_model

* add auto_router_embedding_model

* add AutoRouter

* fix async_pre_routing_hook

* update async_pre_routing_hook

* fix auto router

* fix router.json

* working router init

* working embedding encoder

* working auto router

* test_router_auto_router

* test auto router

* add semantic-router as optional for litellm

* add extras

* semantic_router==0.1.10

* ruff fix

* use aiohttp==3.10.11

* python-dotenv==1.0.1

* test auto router

* test_router_auto_router

* semantic_router

* test_is_auto_router_deployment

* fix check

* fix docker build step

* add semantic_router

* Revert "add semantic_router"

This reverts commit 537b67288798731a119d811f643b682086377ee9.
 2025-07-24 18:32:56 -07:00
Ishaan Jaff
a0a57687ca
fix security - mcp (#12362) 2025-07-07 15:53:54 -07:00
Ishaan Jaff
02b02c739b
[Feat] MCP - Add support for streamablehttp_client MCP Servers (#11628) 
* feat - add https mcp support

* fixes for MCP http integration

* fix code QA

* bump mcp dep

* test_mcp_server_manager_https_server

* test mcp server https

* fix linting error

* bump mcp in poetry

* fix import streamablehttp_client

* fix streamablehttp_client

* fix streamablehttp_client

* add streamablehttp_client
 2025-06-11 17:09:46 -07:00
Ishaan Jaff
dd4a65b83a
Feat: add MCP to Responses API and bump openai python sdk (#11029) 
* feat: add MCP to responses API

* feat: bump openai version to 1.75.0

* docs MCP + responses API

* fixes: type checking

* fixes: type checking

* build: use latest openai 1.81.0

* fix: linting error

* fix: linting error

* fix: test

* fix: linting errors

* fix: test

* fix: test

* fix: linting

* Revert "fix: linting"

This reverts commit ebb19ff8cb1f8fcc3e224390e351676daccb33de.

* fix: linting
 2025-05-22 07:24:10 -07:00
Ishaan Jaff
616c1ad666 fix orjson ci/cd test 2025-04-30 19:37:12 -07:00
Ishaan Jaff
12b3923579 update circle ci requirements 2025-04-04 14:45:14 -07:00
Ishaan Jaff
08a4ba1b7e Merge branch 'main' into litellm_exp_mcp_server 2025-03-24 19:03:56 -07:00
Ishaan Jaff
ffce25cd94 bump deps 2025-03-24 18:44:24 -07:00
Tyler Hutcherson
7864cd1f76 update redisvl dependency 2025-03-24 08:42:11 -04:00
Ishaan Jaff
e85e3bc52a bump to pip install "openai==1.68.2" 2025-03-21 21:49:54 -07:00
Ishaan Jaff
c58aff01e0 bump to openai==1.67.0 2025-03-20 09:26:05 -07:00
Ishaan Jaff
d2c79199b1 bump to 1.66.1 2025-03-12 11:48:53 -07:00
Ishaan Jaff
2507c275f6
(proxy perf improvement) - use uvloop for higher RPS (10%-20% higher RPS) (#7662) 
* uvicorn use uvloop

* fix uvloop==0.21.0

* add uvloop to pyproject

* test_completion_response_ratelimit_headers
 2025-01-09 18:11:20 -08:00
Krish Dholakia
907bcd3a62
Litellm dev 01 08 2025 p1 (#7640) 
* feat(ui_sso.py): support reading team ids from sso token

* feat(ui_sso.py): working upsert sso user teams membership in litellm - if team exists

Adds user to relevant teams, if user is part of teams and team exists on litellm

* fix(ui_sso.py): safely handle add team member task

* build(ui/): support setting team id when creating team on UI

* build(ui/): teams.tsx

allow setting team id on ui

* build(circle_ci/requirements.txt): add fastapi-sso to ci/cd testing

* fix: fix linting errors
 2025-01-08 22:08:20 -08:00
Ishaan Jaff
c047d51cc8
(feat) add Predicted Outputs for OpenAI (#6594) 
* bump openai to openai==1.54.0

* add 'prediction' param

* testing fix bedrock deprecated cohere.command-text-v14

* test test_openai_prediction_param.py

* test_openai_prediction_param_with_caching

* doc Predicted Outputs

* doc Predicted Output
 2024-11-04 21:16:57 -08:00
Ishaan Jaff
13e0b3f626
(feat) Support audio, modalities params (#6304) 
* add audio, modalities param

* add test for gpt audio models

* add get_supported_openai_params for GPT audio models

* add supported params for audio

* test_audio_output_from_model

* bump openai to openai==1.52.0

* bump openai on pyproject

* fix audio test

* fix test mock_chat_response

* handle audio for Message

* fix handling audio for OAI compatible API endpoints

* fix linting

* fix mock dbrx test
 2024-10-18 19:14:25 +05:30
Ishaan Jaff
4e88fd65e1
(feat) openai prompt caching (non streaming) - add prompt_tokens_details in usage response (#6039) 
* add prompt_tokens_details in usage response

* use _prompt_tokens_details as a param in Usage

* fix linting errors

* fix type error

* fix ci/cd deps

* bump deps for openai

* bump deps openai

* fix llm translation testing

* fix llm translation embedding
 2024-10-03 23:31:10 +05:30
Ishaan Jaff
65b42ac35b pin orjson dep on req.txt 2024-08-08 17:36:12 -07:00
Ishaan Jaff
86abd573e4 ci/cd fix linting errors 2024-07-19 12:58:24 -07:00
Ishaan Jaff
5002804d87 (ci/cd) run again 2024-05-31 07:58:11 -07:00
lj
f9d3627fca
Update circle ci requirements.txt 2024-05-31 18:10:00 +08:00
Krrish Dholakia
a2c9482791 ci(circle_ci/requirements.txt): remove unused dependency 2024-04-04 10:01:33 -07:00
Ishaan Jaff
aaf78abe86 (ci/cd) fix langfuse pydantic bug 2024-04-03 20:08:18 -07:00
Krrish Dholakia
bef07eaf09 build(circle_ci/requirements.txt): remove unpinned boto3 dep 2024-03-29 09:22:32 -07:00
Ishaan Jaff
d1fa22f9ed (fix) ci/cd google deps 2024-03-27 19:00:52 -07:00
ishaan-jaff
c4e73768cf (fix) add redisvl==0.0.7 2024-02-06 09:30:45 -08:00
ishaan-jaff
b508e06e69 Revert "(ci/cd) install correct pydantic" 
This reverts commit 256f269ffd.
 2024-01-06 12:07:23 +05:30
ishaan-jaff
256f269ffd (ci/cd) install correct pydantic 2024-01-06 11:50:38 +05:30
ishaan-jaff
7822a8d421 (fix) remove appdirs as a dependency 2023-12-28 11:25:36 +05:30
ishaan-jaff
f32e55780a (ci/cd) add google-cloud-aiplatform 2023-12-07 10:21:09 -08:00
ishaan-jaff
6c6add2a3c (fix) ci/cd 2023-12-01 16:06:22 -08:00
ishaan-jaff
fb8ccdd422 (ci/cd) add orjson as a dep 2023-11-30 20:18:18 -08:00
ishaan-jaff
bcc9ebb78f (chore) clean up ci/cd testing requirements 2023-11-15 17:28:37 -08:00
Krrish Dholakia
f2c8d12eed ci(requirements.txt): enable openai 2023-11-11 19:14:22 -08:00
ishaan-jaff
81d3230651 (test) run ci/cd again 2023-11-06 18:13:18 -08:00
ishaan-jaff
d9a8e01b2a (ci/cd) fix openai==0.28.0 2023-11-06 18:05:18 -08:00