AgentLab

Framework for developing, evaluating and benchmarking web agents on BrowserGym benchmarks, with parallel runs through Ray.

Harness by ServiceNow

IndexedOther★ 657

Write a review

Install

From the package registry. Read the repository before you give any tool access to your data.

pip install agentlab

Get the weekly diff

The weekly diff: one email a week with new agent tools, notable updates and grade changes, plus security alerts for tools you follow. Double opt-in, one-click unsubscribe.

About

AgentLab is a framework for developing and evaluating web agents on benchmarks supported by BrowserGym. Its features include large-scale parallel experiments using Ray, building blocks for agents over BrowserGym, and a unified LLM API for OpenRouter, OpenAI, Azure or a self-hosted TGI endpoint. The README says it is meant for web agent research and is not a consumer product, and it lists reproducibility features and a leaderboard.

Use cases: browser-automation, llm-evaluation

Reviews

Write a review

No reviews yet. Installed it? Reviews come from verified installers only. How reviews work

Fact sheet

Languages: PythonREADME
Packages: agentlab (pypi)README
Model providers: openrouter, openai, azure-openaiREADME
Maturity: ExperimentalREADME

Facts extracted by Claude Haiku 5.5 from the linked sources on Oct 24, 2026. Wrong fact? Tell us.

Alternatives

Frameworks for the same language with a similar way of orchestrating agents.

Signals

Stars: 657
Forks: 134
Open issues: 22
Weekly downloads: 269
Last commit: Oct 6, 2026 (22 days ago)
Last release: Jan 20, 2026 (9 months ago)
Last package publish: Jan 20, 2026 (9 months ago)

From GitHub (fetched Oct 24, 2026) and the package registry.

Details

Packages: pypi agentlab
License: Other
Repository: github.com/ServiceNow/AgentLab
First seen: Oct 24, 2026
Last checked: Oct 24, 2026
Source: README github-graphql