feat: Support xAI native client and openai compatible response client#4010
feat: Support xAI native client and openai compatible response client#4010Wendong-Fan merged 4 commits intomasterfrom
Conversation
|
Important Review skippedAuto reviews are disabled on this repository. Please check the settings in the CodeRabbit UI or the ⚙️ Run configurationConfiguration used: Repository UI Review profile: CHILL Plan: Pro Run ID: You can disable this status message by setting the Use the checkbox below for a quick retry:
✨ Finishing Touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
There was a problem hiding this comment.
Code review is billed via overage credits. To resume reviews, an organization admin can raise the monthly limit at claude.ai/admin-settings/claude-code.
Once credits are available, reopen this pull request to trigger a review.
Summary
Add native xAI model backend using the xai_sdk gRPC package, enabling direct access to Grok models (including grok-4.20-reasoning)
with native features that are unavailable through the OpenAI-compatible endpoint.
Key features
features like encrypted thinking content and server-side conversation storage.
retains the full history and applies automatic prompt caching, significantly reducing token usage and cost.
and injected back into the conversation history, preserving the full reasoning chain.
(system/user/assistant/tool roles, including tool_calls and tool results).
pydantic objects.