MCP host extension

[brucepro]

I was thinking of writing a MCP host extension for textgenui https://modelcontextprotocol.io/introduction but wanted to make sure it wasn't already being added to the core. Thoughts?

[NoxWorld2660]

@brucepro i'd take that !
Havn't found anything like this yet.

[Katehuuh]

I was thinking of writing a MCP host extension for textgenui https://modelcontextprotocol.io/introduction but wanted to make sure it wasn't already being added to the core. Thoughts?

While not a "full" MCP implementation, PR #6827 adds core support via OpenAI-compatible tool calling. The author's assessment of MCP coverage is here; feel free to submit new PRs to improve it if you find gaps.

[timstoop]

Is there any documentation with an example of how this would work? I'm having really trouble understanding where to add what to get it to use my local searxng for web searching.

[brucepro]

I use llamacpp these days with jinja then I use pydantic-ai to assign the tools these days. I haven't had any time to work on text-gen as it seems like textgen is getting out paced by other ux's

[brucepro]

Here is my pydantic-ai code for searxng
import httpx
from typing import Dict, Any, List
from pydantic_ai import RunContext
from monitoring import logger
from tools import log_tool_usage

@log_tool_usage
async def search_web(ctx: RunContext, query: str, limit: int = 5) -> Dict[str, Any]:
"""
Search the web using the local SearxNG instance.

Args:
    query: Search query string
    limit: Maximum number of results to return
    
Returns:
    Dictionary containing search results with title, url, and snippet
"""
try:
    url = "http://localhost:4000/search"
    params = {
        "q": query,
        "format": "json",
        "language": "en",
        "categories": "general",
        "safesearch": 1,
        "count": limit
    }
    
    async with httpx.AsyncClient(timeout=10) as client:
        response = await client.get(url, params=params)
        response.raise_for_status()
        
    data = response.json()
    results = []
    
    for r in data.get("results", [])[:limit]:
        results.append({
            "title": r.get("title", ""),
            "url": r.get("url", ""),
            "snippet": r.get("content", "")
        })
        
    return {
        'status': 'success',
        'results': results,
        'query': query,
        'total_results': len(results)
    }
except Exception as e:
    logger.error(f"SearxNG search failed: {e}")
    return {
        'status': 'error',
        'results': [],
        'error': str(e),
        'query': query
    }