Krish Dholakia 34bdf36eab Add inference providers support for Hugging Face (#8258) (#9738) (#9773) ... * Add inference providers support for Hugging Face (#8258) * add first version of inference providers for huggingface * temporarily skipping tests * Add documentation * Fix titles * remove max_retries from params and clean up * add suggestions * use llm http handler * update doc * add suggestions * run formatters * add tests * revert * revert * rename file * set maxsize for lru cache * fix embeddings * fix inference url * fix tests following breaking change in main * use ChatCompletionRequest * fix tests and lint * [Hugging Face] Remove outdated chat completion tests and fix embedding tests (#9749) * remove or fix tests * fix link in doc * fix(config_settings.md): document hf api key --------- Co-authored-by: célina <hanouticelina@gmail.com>		2025-04-05 10:50:15 -07:00
..
benchmark	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
codellama-server	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
community-resources	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
litellm_proxy_server	Update readme.md	2024-10-07 18:15:15 +05:30
litellm_router	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
litellm_router_load_test	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
litellm-ollama-docker-image	build(deps): bump litellm in /cookbook/litellm-ollama-docker-image	2025-03-20 21:03:29 +00:00
logging_observability	docs litellm x langfuse cookbook	2025-02-14 09:31:51 -08:00
misc	fix dev release.txt	2025-04-01 12:02:51 -07:00
Benchmarking_LLMs_by_use_case.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
Claude_(Anthropic)_with_Streaming_liteLLM_Examples.ipynb
Evaluating_LLMs.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
liteLLM_A121_Jurrasic_example.ipynb
LiteLLM_Azure_and_OpenAI_example.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
liteLLM_Baseten.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
LiteLLM_batch_completion.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
LiteLLM_Bedrock.ipynb
liteLLM_clarifai_Demo.ipynb
LiteLLM_Comparing_LLMs.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
LiteLLM_Completion_Cost.ipynb
liteLLM_function_calling.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
liteLLM_Getting_Started.ipynb
LiteLLM_HuggingFace.ipynb	Add inference providers support for Hugging Face (#8258) (#9738) (#9773)	2025-04-05 10:50:15 -07:00
liteLLM_IBM_Watsonx.ipynb
liteLLM_Langchain_Demo.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
litellm_model_fallback.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
liteLLM_Ollama.ipynb
LiteLLM_OpenRouter.ipynb
LiteLLM_Petals.ipynb
LiteLLM_PromptLayer.ipynb
liteLLM_Replicate_Demo.ipynb
liteLLM_Streaming_Demo.ipynb
litellm_test_multiple_llm_demo.ipynb
litellm_Test_Multiple_Providers.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
LiteLLM_User_Based_Rate_Limits.ipynb
liteLLM_VertextAI_Example.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
Migrating_to_LiteLLM_Proxy_from_OpenAI_Azure_OpenAI.ipynb
mlflow_langchain_tracing_litellm_proxy.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
Parallel_function_calling.ipynb
Proxy_Batch_Users.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
result.html
TogetherAI_liteLLM.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
Using_Nemo_Guardrails_with_LiteLLM_Server.ipynb	(code quality) run ruff rule to ban unused imports (#7313)	2024-12-19 12:33:42 -08:00
VLLM_Model_Testing.ipynb