“Model inference”

Guide and resources for deployment and development using the ROCm/AMD ATOM (AiTer Optimized Model) inference backend.

Unified inference platform for deploying and scaling AI models on any cloud, with an open-source Python serving framework.

Deploys and optimizes AI/ML inference workloads on GKE, using GPUs, TPUs, and model servers.

Inference and training platform for hosted and dedicated models, deployable in your cloud or Baseten's.

Local AI over Ollama for low connectivity: status, local inference, model and deployment guides.

AI inference pricing for agents: live and historical model prices, provider comparison.

Connects NemoClaw to a local inference server.

Manage your Onde Inference account and models: apps, model catalog, fine-tuned GGUF deploys.

Connects to and performs inference with Google Cloud Agent Platform GenAI models, including First-Party Gemini models and Third-Party OpenMaaS models (Llama…

OpenAI-compatible multi-model inference via ComputeFlux (Polkadot testnet, TEE-verifiable).

Use when product or application work adds, changes, reviews, tests, or evaluates model behavior, inference prompts, model context, model tools, routing…

Open-source platform for serving LLM, embedding and multimodal models on your own premises or in the cloud.

Use verified service mesh patterns for AI inference traffic management, mTLS, canary releases, policy enforcement, and cross-cluster resilience.

Managed Ray platform for distributed training, batch inference and data processing on GPU clusters.

Orchestrate AI/ML pipelines for data ingestion, model training, batch inference, and RAG indexing using Prefect, Airflow, or Dagster.

Plain C/C++ LLM inference engine that runs quantized models on many hardware backends, with an OpenAI-compatible server.

Generate authentic pixel art - sprites, animations, and tilesets - from any MCP client

Production-grade Bayesian causal inference with PyMC, CausalPy, and DoWhy.

Apply C4 component diagram concepts accurately.

Use when working on Cosmos world model serving, inference, serverless training smoke validation, backend selection, or rendering limitations.

Hugging Face CLI to estimate the required memory to load Safetensors or GGUF model weights for inference from the Hugging Face Hub

Use when the user wants to optimize configurable system parameters against a measurable scalar objective, especially for model training, inference…

Pay-per-token Claude & Grok inference, settled in BSV, via the inference.bsvkey.com gateway.

Exports sanitized metadata, parameters, reproducibility details, quality metrics, and optional review artifacts from Medical AI inference runs or evidence…