“Model inference”

Use for on-device or server inference that is not tied to one vendor model: ONNX Runtime, Sentis, Barracuda legacy, custom .onnx/.tflite/.pb assets, and…

Guide and resources for deployment and development using the ROCm/AMD ATOM (AiTer Optimized Model) inference backend.

Deploys and optimizes AI/ML inference workloads on GKE, using GPUs, TPUs, and model servers.

Local AI over Ollama for low connectivity: status, local inference, model and deployment guides.

AI inference pricing for agents: live and historical model prices, provider comparison.

Manage your Onde Inference account and models: apps, model catalog, fine-tuned GGUF deploys.

Unified inference platform for deploying and scaling AI models on any cloud, with an open-source Python serving framework.

Inference and training platform for hosted and dedicated models, deployable in your cloud or Baseten's.

Open-source platform for serving LLM, embedding and multimodal models on your own premises or in the cloud.

GLM-5.3-FlashX is the high-speed variant of Z.ai's GLM-5.3-Flash, a native multimodal model delivering inference speeds of up to 200 tokens/s.

Schematron V2 Small is a 3B-parameter HTML-to-JSON extraction model from Inference.net.

Schematron V2 Turbo is a 3B-parameter HTML-to-JSON extraction model from Inference.net.

Kairos Signal: verifiable DePIN and physical-world data, with cryptographic receipts on its REST data API (ed25519-signed responses, Bitcoin-anchored daily…

OpenAI-compatible inference on open-weight models, served on hardware Linkrra owns and operates.

Open-source desktop agent combining real-time voice chat, a speaking character and delegated work with visible permissions.

CLAUDE.md from cheaper-inference/OmniRoute: 72 lines covering Worktree isolation — Claude Code specifics, Cross-session safety — Claude Code specifics…

AGENTS.md from cheaper-inference/OmniRoute: 448 lines covering Quick Start, Project at a Glance, Request Pipeline, Resilience Runtime State and more.

AGENTS.md from xorbitsai/inference: 213 lines covering Project Overview, Working Rules, Environment Setup, Formatting and Linting and more.

BYOK Models — OpenAI-Compatible Provider

cristall

Zero-touch dynamic language model provider for local inference.

twinny - AI Code Completion and Chat

twinnydotdev

AI code completion, chat, inline edit and code review on models you run.

vLLM-Copilot

System-Sciences

vLLM (& OpenRouter) integration for GitHub Copilot & Agents window on self-hosted and remote servers (supports full featureset of vLLM, OpenRouter and Copilot).

Small Python library whose agents write their actions as code, with sandboxed execution and tools from MCP servers, LangChain or the Hub.

OpenAI-compatible agentic API server for inference, vector stores, files and skills, on any model or infrastructure.

Open-source LLM function calling framework for AI agents, with serverless LLM tools and geo-distributed infrastructure.