Skip to content

feat(tools): add tool dispatch and agentic docs #2063

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
EricLBuehler merged 6 commits into from
Apr 6, 2026
Merged

feat(tools): add tool dispatch and agentic docs #2063

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
6 commits
Select commit Hold shift + click to select a range
f0e12cd
Add max tool rounds
EricLBuehler Apr 6, 2026
81357ab
feat(tools): add http tool dispatch
EricLBuehler Apr 6, 2026
eed5dbd
feat(tools): add CLI agentic flags, secure tool dispatch, Python SDK …
EricLBuehler Apr 6, 2026
e75f22b
Add agents docs
EricLBuehler Apr 6, 2026
0a7efe0
Simplify docs
EricLBuehler Apr 6, 2026
976c1e7
Simplify docs
EricLBuehler Apr 6, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
11 changes: 7 additions & 4 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,7 +37,7 @@ Fast, flexible LLM inference.
- **Built-in web UI**: `mistralrs serve --ui` gives you a web interface instantly.
- **Hardware-aware**: `mistralrs tune` benchmarks your system and picks optimal quantization + device mapping.
- **Flexible SDKs**: Python package and Rust crate to build your projects.
- **Agentic features** — tool calling, web search, and MCP client built in
- **[Agentic features](docs/AGENTS.md)** — server-side tool loop, web search, MCP client, and HTTP tool dispatch

## Quick Start

Expand Down Expand Up @@ -120,9 +120,12 @@ mistralrs doctor
- [Multiple models](docs/multi_model/README.md): Load/unload at runtime

**Agentic Features**
- Integrated [tool calling](docs/TOOL_CALLING.md) with Python/Rust callbacks
- ⭐ [Web search integration](docs/WEB_SEARCH.md)
- ⭐ [MCP client](docs/MCP/client.md): Connect to external tools automatically
- Integrated [tool calling](docs/TOOL_CALLING.md) with grammar enforcement and strict schema mode
- ⭐ Server-side [agentic loop](docs/TOOL_CALLING.md#agentic-loop): auto-execute tools and feed results back
- ⭐ [Tool dispatch URL](docs/TOOL_CALLING.md#tool-dispatch-url): POST tool calls to your own endpoint
- ⭐ [Web search integration](docs/WEB_SEARCH.md) with embedding-based ranking
- ⭐ [MCP client](docs/MCP/client.md): Connect to external tools via Process, HTTP, or WebSocket
- Python/Rust [tool callbacks](docs/TOOL_CALLING.md#tool-callbacks) for custom execution

[Full feature documentation](docs/README.md)

Expand Down
Loading