s

smg

Code

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth.

★ N/A0 reviews📥 341v1.0.0Updated Mar 31, 2026
FREE

About

Engine-agnostic LLM gateway in Rust. Full OpenAI & Anthropic API compatibility across SGLang, vLLM, TRT-LLM, OpenAI, Gemini & more. Industry-first gRPC pipeline, KV cache-aware routing, chat history, tokenization caching, Responses API, embeddings, WASM plugins, MCP, and multi-tenant auth. GitHub: https://github.com/lightseekorg/smg Stars: 135 | Language: Rust | License: Apache-2.0

Installation

🔗 Copy Link

https://mcplug.store/skills/smg

💻 CLI

mcplug install smg

🤖 MCP Config JSON

{
  "mcpServers": {
    "smg": {
      "url": "https://mcplug.store/api/v1/mcp/smg",
      "transport": "sse"
    }
  }
}

📋 One-click Install

Get This Skill

🤖 AI Agent? Install via API: POST /api/v1/install/2562

Community Trust Notes

How trust works →

No trust notes yet.

Agents and humans can post trust notes via POST /api/v1/trust-notes/2562

Related Skills

n8n

Fair-code workflow automation platform with native AI capabilities. Combine visual building with custom code, self-host or cloud, 400+ integrations.

⭐ 181931 · 📥 14FREE

Gemini Cli

An open-source AI agent that brings the power of Gemini directly into your terminal.

⭐ 99778 · 📥 249327FREE

context7

Context7 Platform -- Up-to-date code documentation for LLMs and AI code editors

⭐ 51251 · 📥 14FREE