RooCode, Cline, Claude Code, OpenWebUI Integration Improvements

[krrishdholakia]

The Feature

Starting this discussion for improving LiteLLM's support for IDE integrations (RooCode, Cline, Claude Code, OpenWebUI, etc.).

• Claude Code - support for non-Anthropic models
• General - support for LiteLLM 'smart' / 'auto' router - allow proxy admin to configure the models to use for this, help reduce cost for simpler questions
• General - improved retry logic for streaming errors - [Feature]: Improving Retry Mechanism Consistency and Logging for Streamed Responses in LiteLLM Proxy #8648

Just do a +1 [feature] for any you find interesting, or add one below

[maxjacu]

1. done
2. interested
3. Critical: if rate errors in stream mode are simply thrown, the promise of litellm to offer smart fallbacks is going out of the window

[ishaan-jaff]

@maxjacu following up with you on the issue