agents-libagents-lib
AgentsMCP ServersWorkflowsTutorialsComparisonsTemplatesNewsAbout
🔌

Groq MCP

AI Providers•⭐ 1,800

Access Groq's ultra-fast LPU inference API for Llama, Mixtral, Gemma, and other models.

GitHubWebsite →
Claude DesktopCursorWindsurf

Overview

Access Groq's ultra-fast LPU inference API for Llama, Mixtral, Gemma, and other models.

Setup

Run with npx:

npx -y @modelcontextprotocol/server-groq

Configuration

GROQ_API_KEY environment variable

Documentation

Groq MCP (Enhanced)

Overview

Groq MCP provides access to Groq's ultra-fast LPU inference API, enabling AI agents to use Llama, Mixtral, Gemma, and other open models with exceptional speed.

Features

  • Ultra-fast inference
  • Multiple model support
  • Streaming responses
  • Batch processing
  • Cost-effective pricing

Installation

npx -y @modelcontextprotocol/server-groq

Configuration

Set the GROQ_API_KEY environment variable:

export GROQ_API_KEY=your_groq_api_key

Get your API key from https://console.groq.com/keys.

Available Models

ModelDescription
llama-3.3-70b-versatileLatest Llama 3.3 70B
llama-3.1-8b-instantFast Llama 3.1 8B
mixtral-8x7b-32768Mixtral 8x7B
gemma2-9b-itGoogle Gemma 2 9B

Usage Examples

Chat Completion

{
  "model": "llama-3.3-70b-versatile",
  "messages": [
    { "role": "user", "content": "Explain quantum computing" }
  ]
}

Streaming

{
  "model": "llama-3.1-8b-instant",
  "messages": [...],
  "stream": true
}

Pros

  • ✅ Ultra-fast inference
  • ✅ Multiple open models
  • ✅ Cost-effective
  • ✅ Streaming support

Cons

  • ❌ Requires Groq API key
  • ❌ Limited to Groq models
  • ❌ Rate limits apply

Resources