Testing

Adds and runs data quality checks (dbt-test style assertions) on a project's warehouse tables and saved-query views, and HogQL catalog metrics: not-null…

Build a Loop for PostHog Desktop: a workflow that creates an AI task each time its trigger fires, optionally followed by a Slack or email notification with…

Designs a Replay Vision scanner that produces trustworthy observations: one visible question per scanner, a type chosen from the answer shape, a query that…

Create new skills, modify and improve existing skills, and measure skill performance.

Helps migrate self-managed Apache Kafka workloads to Amazon MSK Express.

Toolkit for interacting with and testing local web applications using Playwright.

Analyze session replay patterns across experiment variants to understand user behavior differences.

Persistent browser and Electron interaction through `js_repl` for fast iterative UI debugging.

Create and scaffold plugin directories for Codex with a required `.codex-plugin/plugin.json`, optional plugin folders/files, and baseline placeholders you can…

Generate realistic synthetic data using Spark + Faker (strongly recommended).

Build RAG / unstructured-document evaluation datasets and demo documents (e.g.

Connects to and performs inference with Google Cloud Agent Platform GenAI models, including First-Party Gemini models and Third-Party OpenMaaS models (Llama…

Tests Amazon MWAA workflow execution end-to-end: trigger a run and monitor it to completion for Provisioned (Python DAG, via Airflow REST API) and Serverless…

Design assertions that prove the actual contract and fail on realistic regressions

Create Databricks AI/BI dashboards.

Authors and edits AWS Step Functions state machines: writes Amazon States Language (ASL) in JSONata, and chooses and structures state types (Task, Choice…

Create and troubleshoot AWS Glue connections to JDBC databases (Oracle, SQL Server, PostgreSQL, MySQL, RDS), Redshift, Snowflake, and BigQuery.

Pre-deployment validation for Azure readiness.

Perform code reviews following Sentry engineering practices.

Volcengine Cloud Detect (云拨测) API integration for creating detection tasks, retrieving results, generating reports, and managing detection nodes.

Orchestrates Volcengine Cloud Detect (云拨测) false-alarm reduction for failing periodic-task dial points.

Develop examples for AI SDK functions.

Capture API response test fixture.

Guide for adding new AI function examples, for testing specific features against the actual provider APIs.