Groq
Fast LLM inference API that is OpenAI-compatible, for running open models.
Infrastructure by Groq
IndexedLicense unknown
Install
Pick your client. Read the repository before you give any tool access to your data.
pip install groq
Get the weekly diff
The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.
About
Groq provides LLM inference through an API that the OpenAI SDK can call by changing the base URL. The docs cover text, speech, vision, structured outputs, reasoning and prompt caching. Tool use includes remote tools and MCP connectors, and service tiers cover flex and batch processing.
Use cases: model-inference
Reviews
Write a reviewNo reviews yet. Installed it? Reviews come from verified installers only. How reviews work
Fact sheet
- Category
- Inference · api
- Protocols
- openai-compatible, mcpconsole.groq.com
Facts read from the vendor's own pages by claude-haiku-5-5 on Oct 24, 2026; a fact is shown only with the page it came from.
Details
- Packages
- pypi
groqnpmgroq-sdk - License
- License unknown
- Website
- groq.com
- First seen
- Oct 24, 2026
- Last checked
- Oct 24, 2026
- Source
- Package pageWebsiteDocs
Cite this page
Groq. Agent Mart. https://agentmart.dev/infrastructure/groq (last updated 2026-10-24)