🧹 Refactor init.py to use a model registry #12138
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters. Learn more about bidirectional Unicode characters
| The latest updates on your projects. Learn more about Vercel for Git ↗︎
|
ishaan-jaff added a commit that referenced this pull request Jun 28, 2025
This reverts commit f93326a.
ishaan-jaff added a commit that referenced this pull request Jun 28, 2025
krrishdholakia added a commit that referenced this pull request Jul 3, 2025
* fix - using on python 3.9 * [⚡️ Python SDK Import] - 2 second faster import times (#12135) * speedup - move wb logger to conditional * fix import path * docs(index.md): initial pre-release note * 🧹 Refactor init.py to use a model registry (#12138) * fix - refactor init to use a registry * # noqa: PLR0915 * fix import loc * test whitelisted models * Revert "🧹 Refactor init.py to use a model registry (#12138)" (#12141) This reverts commit f93326a. * [⚡️ Python SDK import] - reduce python sdk import time by .3s (#12140) * use 1 file for KeyManagementSystem * move key management settings * fix import locs * test_proxy_types_not_imported * test the import loc * fix import item * fix imports * fix import loc * fix imports * fix imports * fix - revert list team changes * fix for o-series param checks * bump poetry * docs(index.md): update release note with cleaner table for updated models * `/v1/messages` - Remove hardcoded model name on streaming + Tags - enable setting custom header tags (#12131) * fix(anthropic/experimental_pass_through): use given model name when returning streaming chunks don't harcode model name on streaming confusing for user * fix(anthropic/streaming_iterator.py): remove scope of import * feat(litellm_logging.py): allow admin to specify additional headers for using as spend tags Closes #12129 * test(test_litellm_logging.py): add unit tests * feat(openweb_ui.md): add custom tag tutorial to docs * docs(cost_tracking.md): add tag based usage UI screenshot * test: update test * fix: fix import * docs - update release notes * Benefits of using gemini-cli with LiteLLM * UI QA Fixes - prevent team model reset on model add + return team-only models on /v2/model/info + render team member budget correctly (#12144) * fix(team_endpoints.py): prevent overwriting current list of team models on new model add * fix(networking.tsx): fix default proxy base url * fix(proxy_server.py): include team only models when retrieving all deployments on `/v2/model/info` helper util ensures team only models are shown to user * fix(router.py): check model name by team public model name when team id given Fixes issue where team member could not see team only models when clicking into that team on `Models + Endpoints` * fix(team_member_view.tsx): fix rendering team member budget, when budget is set * test: update tests * test: update unit test * docs gemini cli x litellm * docs: index.md release note cleanup * docs(index.md): add more hyperlinks to docs * docs(index.md): add batch api cost tracking to docs * docs(index.md): update docs * VertexAI Anthropic - streaming cost tracking w/ prompt caching fixes (#12188) * fix(rebuild-usage-object---ensure-cache_tokens-is-set): Ensures cache tokens is correctly set Fixes #12149 * test(test_stream_chunk_builder_utils.py): add unit test to ensure cached tokens is part of stream chunk builder Ensures standardized values are used * Fix rendering ui on non-root images (#12226) * fix(proxy_server.py): only rewrite server_root_path if path set Fixes UI rendering issue on non-root images * docs(custom_root_ui.md): clarify custom root path doesn't work on non-root images * build(pyproject.toml): version rc2 * fix(streaming_handler.py): store finish reason, even if is_finished is false - allows storing early gemini finish reasons (#12250) Fixes #12249 --------- Co-authored-by: Ishaan Jaff <ishaanjaffer0324@gmail.com>
satendrakumar pushed a commit to satendrakumar/litellm that referenced this pull request Jul 24, 2025
* fix - refactor init to use a registry * # noqa: PLR0915
satendrakumar pushed a commit to satendrakumar/litellm that referenced this pull request Jul 24, 2025
…erriAI#12141) This reverts commit f93326a.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Add this suggestion to a batch that can be applied as a single commit. This suggestion is invalid because no changes were made to the code. Suggestions cannot be applied while the pull request is closed. Suggestions cannot be applied while viewing a subset of changes. Only one suggestion per line can be applied in a batch. Add this suggestion to a batch that can be applied as a single commit. Applying suggestions on deleted lines is not supported. You must change the existing code in this line in order to create a valid suggestion. Outdated suggestions cannot be applied. This suggestion has been applied or marked resolved. Suggestions cannot be applied from pending reviews. Suggestions cannot be applied on multi-line comments. Suggestions cannot be applied while the pull request is queued to merge. Suggestion cannot be applied right now. Please check back later.
🧹 Refactor init.py to use a model registry
Small QOL improvement to use a model_registry.py file instead of bloating init.py
Relevant issues
Pre-Submission checklist
Please complete all items before asking a LiteLLM maintainer to review your PR
tests/litellm/directory, Adding at least 1 test is a hard requirement - see detailsmake test-unitType
🧹 Refactoring
Changes