LiteLLM 1.104
Last reviewed Oct 26, 2026
Prompt Details
Prompt Composition
2prompts
- Python 3155 lines · 3.8K tokens
- LiteLLM 1.10441 lines · 1.7K tokens
Total196 lines · 5.5K tokens
CWE Coverage
- 20
- 23
- 36
- 59
- 78
- 79
- 89
- 95
- 117
- 201
- 208
- 209
- 214
- 250
- 287
- 295
- 306
- 319
- 328
- 338
- 347
- 367
- 379
- 409
- 416
- 426
- 427
- 470
- 488
- 494
- 502
- 522
- 524
- 532
- 611
- 613
- 639
- 674
- 732
- 749
- 770
- 772
- 776
- 807
- 829
- 862
- 916
- 918
- 942
- 1104
- 1333
- 1395
- 1426
- 1427
Prompt Preview
Apply this prompt to the LiteLLM 1.104 SDK and proxy. Treat the proxy as a credentialed gateway with its own authorization and storage rules, even when an application already authenticated the caller.
Boot and credentials
- Use a security-supported CPython minor accepted by the package's
>=3.10,<3.15metadata and test selected extras on it. Review PyPI and container artifacts separately; verify an image signature against the release's trusted cosign key and deploy the verified digest. - Set a strong random
LITELLM_MASTER_KEYin protected runtime configuration; leaveLITELLM_DANGEROUSLY_PERMIT_WEAK_OR_UNSET_MASTER_KEYanddangerously_permit_weak_or_unset_master_keydisabled. Keep the master key out of client SDKs, logs, and browser code. - Preserve the separate
LITELLM_SALT_KEYwhen rotating the master key, and use the documented migration mechanism for database values encrypted with an old master key. Store provider and MCP credentials in protected secret storage; scope each upstream credential to its intended provider or server. - Keep
ENFORCE_PRISMA_MIGRATION_CHECKenabled and stop serving if database setup fails. Run schema migration with a controlled identity before accepting traffic; do not turn database errors into authenticated but unbounded access.
Keys and sessions
- Generate one expiring virtual key per application or service, with narrow
models,allowed_routes,team_id, andobject_permission. Emptymodels,*, and proxy-admin roles are broad grants; confirm effective rights with denied-model and denied-route tests. - Authenticate