- Add AWS ECS Fargate stack with Aurora Postgres (IAM auth), ElastiCache Redis, S3, ALB with path-based routing to gateway/backend/ui components, Application Auto Scaling, and automated DB bootstrap + prisma migration via local-exec provisioners - Add GCP Cloud Run stack with Cloud SQL Postgres (password auth), Memorystore Redis, GCS, external HTTPS load balancer with serverless NEGs and URL map routing, and automated prisma migration via Cloud Run Job - Both stacks support typed proxy_config input mirroring the helm chart's gateway.config.proxy_config, per-component extra env vars, and Secret Manager references for provider API keys - Gateway/backend services depend on terraform_data.migration so they never start before the schema is in place, eliminating crash-loop windows on first apply - AWS stack uses IAM database authentication with a one-shot Fargate bootstrap task that creates and grants the rds_iam role to the application user; GCP stack uses password auth assembled at container startup to avoid Cloud SQL Auth Proxy sidecar complexity - Add .gitignore rules for Terraform state files, plan files, tfvars inputs, provider binaries, and crash logs while explicitly keeping .terraform.lock.hcl for provider version pinning - Include terraform.tfvars.example files, provider lock files, and comprehensive README documentation covering architecture, TLS setup, image pull strategies, and quick-start instructions for both stacks Co-authored-by: Yassin Kortam <yassinkortam@g.ucla.edu>
123 lines
3.2 KiB
Plaintext
123 lines
3.2 KiB
Plaintext
.python-version
|
|
.venv
|
|
.venv_policy_test
|
|
.env
|
|
.claude
|
|
.newenv
|
|
newenv/*
|
|
litellm/proxy/myenv/*
|
|
litellm_uuid.txt
|
|
__pycache__/
|
|
*.pyc
|
|
bun.lockb
|
|
**/.DS_Store
|
|
.aider*
|
|
litellm_results.jsonl
|
|
secrets.toml
|
|
.gitignore
|
|
litellm/proxy/litellm_secrets.toml
|
|
litellm/proxy/api_log.json
|
|
.idea/
|
|
router_config.yaml
|
|
litellm_server/config.yaml
|
|
litellm/proxy/_secret_config.yaml
|
|
.aws-sam/
|
|
litellm/tests/aiologs.log
|
|
litellm/tests/exception_data.txt
|
|
litellm/tests/config_*.yaml
|
|
litellm/tests/langfuse.log
|
|
langfuse.log
|
|
.langfuse.log
|
|
litellm/tests/test_custom_logger.py
|
|
litellm/tests/langfuse.log
|
|
litellm/tests/dynamo*.log
|
|
.vscode/settings.json
|
|
litellm/proxy/log.txt
|
|
proxy_server_config_@.yaml
|
|
.gitignore
|
|
proxy_server_config_2.yaml
|
|
litellm/proxy/secret_managers/credentials.json
|
|
hosted_config.yaml
|
|
litellm/proxy/tests/node_modules
|
|
litellm/proxy/tests/package.json
|
|
litellm/proxy/tests/package-lock.json
|
|
ui/litellm-dashboard/.next
|
|
ui/litellm-dashboard/node_modules
|
|
ui/litellm-dashboard/next-env.d.ts
|
|
ui/litellm-dashboard/package.json
|
|
ui/litellm-dashboard/package-lock.json
|
|
deploy/charts/litellm/*.tgz
|
|
deploy/charts/litellm/charts/*
|
|
deploy/charts/*.tgz
|
|
litellm/proxy/vertex_key.json
|
|
**/.vim/
|
|
**/node_modules
|
|
kub.yaml
|
|
loadtest_kub.yaml
|
|
litellm/proxy/_new_secret_config.yaml
|
|
litellm/proxy/_new_secret_config.yaml
|
|
litellm/proxy/_super_secret_config.yaml
|
|
litellm/proxy/_super_secret_config.yaml
|
|
litellm/proxy/myenv/bin/activate
|
|
litellm/proxy/myenv/bin/Activate.ps1
|
|
myenv/*
|
|
litellm/tests/log.txt
|
|
litellm/tests/langfuse.log
|
|
litellm/tests/langfuse.log
|
|
litellm/proxy/google-cloud-sdk/*
|
|
tests/llm_translation/log.txt
|
|
venv/
|
|
tests/local_testing/log.txt
|
|
|
|
.codegpt
|
|
litellm/proxy/_new_new_secret_config.yaml
|
|
litellm/proxy/custom_guardrail.py
|
|
**/.mypy_cache/
|
|
litellm/proxy/application.log
|
|
tests/llm_translation/vertex_test_account.json
|
|
tests/llm_translation/test_vertex_key.json
|
|
litellm/proxy/migrations/0_init/migration.sql
|
|
litellm/proxy/db/migrations/0_init/migration.sql
|
|
litellm/proxy/db/migrations/*
|
|
litellm/proxy/migrations/*config.yaml
|
|
litellm/proxy/migrations/*
|
|
litellm/proxy/to_delete_loadtest_work/*
|
|
config.yaml
|
|
tests/litellm/litellm_core_utils/llm_cost_calc/log.txt
|
|
tests/test_custom_dir/*
|
|
test.py
|
|
|
|
litellm_config.yaml
|
|
!.github/observatory/litellm_config.yaml
|
|
.cursor
|
|
litellm/proxy/to_delete_loadtest_work/*
|
|
update_model_cost_map.py
|
|
tests/test_litellm/proxy/_experimental/mcp_server/test_mcp_server_manager.py
|
|
scripts/test_vertex_ai_search.py
|
|
LAZY_LOADING_IMPROVEMENTS.md
|
|
STABILIZATION_TODO.md
|
|
**/test-results
|
|
**/playwright-report
|
|
**/*.storageState.json
|
|
**/coverage
|
|
test-config
|
|
|
|
# ---------- Terraform ----------
|
|
# Provider binaries + module cache — regenerated by `terraform init`.
|
|
**/.terraform/
|
|
# State files often contain secrets (DB passwords, API keys snapshotted from
|
|
# data sources). Keep state in a remote backend, never in git.
|
|
*.tfstate
|
|
*.tfstate.*
|
|
*.tfstate.backup
|
|
# Plan files can also contain sensitive values (variables in plaintext).
|
|
*.tfplan
|
|
# User-specific variable inputs — example files (terraform.tfvars.example) are
|
|
# tracked because they end in .example, which doesn't match the glob below.
|
|
*.tfvars
|
|
*.auto.tfvars
|
|
crash.log
|
|
crash.*.log
|
|
# .terraform.lock.hcl is intentionally NOT ignored — it pins provider versions
|
|
# and should be committed.
|
|
.vscode |