“Model inference”

First-principles ML: classical methods, optimization, Gaussian processes, deep learning, probabilistic inference, generative models, RL.

Pay-per-token Claude & Grok inference, settled in BSV, via the inference.bsvkey.com gateway.

Exports sanitized metadata, parameters, reproducibility details, quality metrics, and optional review artifacts from Medical AI inference runs or evidence…

Builds and checks Bayesian models with PyMC, including hierarchical models, NUTS MCMC, variational inference, mutable-data predictions, posterior predictive…

Create and validate Earth2Studio data source wrappers (DataSource, ForecastSource, DataFrameSource, ForecastFrameSource) from remote stores.

Pick the serving stack and per-runtime memory flags (vLLM, SGLang, llama.cpp, TensorRT Edge-LLM) for an LLM/VLM workload on any NVIDIA Jetson.

Detect MITRE ATLAS AML.T0024 attacks (model stealing, inversion, membership inference) performed via inference-API abuse, by monitoring per-principal query…

Diagnose Day-2 AKS GPU and KAITO incidents using profile-aware, read-only evidence.

Plan and coordinate the deployment of a model to Amazon SageMaker AI.

Generates and updates secure, production-ready Kubernetes YAML manifests optimized for GKE Autopilot and GKE Standard clusters.

Build deterministic forecast scripts with Earth2Studio (model, data source, IO, inference).

Deployment option comparison (serverless, dedicated, self-hosted, batch) and Workflow execution patterns.

Inspect current Antigravity model recommendations: balanced, flash, auto, or custom.

Start and test the prime-rl inference server.

Hugging Face Transformers for loading Hub models, running pipeline inference, text generation, and Trainer fine-tuning on NLP, vision, audio, and multimodal…

Use CausalML for causal inference, uplift modeling, matching, validation, interpretation, and treatment optimization workflows.

Reduce LLM size and accelerate inference using pruning techniques like Wanda and SparseGPT.

Complete toolkit for Huawei Ascend NPU model conversion and end-to-end inference adaptation.

Reverse-engineers any app into a recon map: screen inventory, user flows, component list, inferred data model and a feature matrix, from public pages…

Run 150+ AI apps via inference.sh CLI (infsh) — image generation, video creation, LLMs, search, 3D, social automation.

THE skill for running a trained policy (INFERENCE) in Newton on the Jetson Thor: play / watch / test / evaluate / benchmark a robot policy.

Inspect a pinned model revision and produce an evidence-backed ModelSupportCard for vLLM-Kunlun adaptation.

The core OpenAI-compatible inference endpoints: chat completions, embeddings, images, audio (TTS/STT), moderations, rerank, and the Responses API.

Uses the Biohub esm Python SDK for ESM3 protein generation, ESMC embeddings, and ESMFold2 all-atom folding.