rl-list.com
UPDATED 2026.07.15
RL List/RL Environments for Computer-Use & Browser Agents

RL Environments for Computer-Use & Browser Agents

Computer-use and browser agents operate software the way a person does, clicking, typing, and navigating a real or simulated desktop, browser, or GUI. Training them requires environments that faithfully replicate that surface: web apps, enterprise tools such as Salesforce, Slack, and Excel, and full desktop operating systems, wired up with state tracking and automated scoring so an agent can be rewarded for completing a multi-step task. The vendors below build these computer-use environments, often as deterministic clones of production software, plus the human trajectory data that shows agents how the work is done. Each company is profiled from public sources and vendor-shared information, with every figure cited and confidence-tagged. Only dedicated commercial vendors are ranked; incumbents and infrastructure are listed for reference.

13 ranked commercial vendors of 18 tracked · ranked within this category by the RL List score plus a few editorial placements · updated 2026-07-15 · methodology
#1

AfterQuery

Commercial
AfterQuery is a San Francisco applied-research lab and data platform (YC W25) that supplies frontier AI labs with expert-generated human data (SFT, RL rubrics), agent/RL environments, and computer-use trajectories, drawn from a large network of verified practitioners. It publishes real-task benchmarks such as Terminal-Bench, VADER, FinanceQA, and IDE-Bench, positioning around capturing how domain experts (engineers, financial analysts, lawyers) reason.
Raised
$30.5M ↑ $30M
Headcount
51-200
Founded
2025
SOC 2
unknown
Researchers
yes
Open src
yes
Backers: Altos Ventures (lead, Series A), The Raine Group, Y Combinator
CodeComputer UseEnterprise
site ↗
#2

Huzzle Labs

Commercial
Huzzle Labs is the AI division of London-based talent platform Huzzle (founded ~2020 by Ingmar Klein, Parham Rakhshanfar, and Amit Choudhary). It positions itself as a human-intelligence data foundry that builds RL environments (code, tool-use, computer-use, long-horizon enterprise workflows), expert trajectory data, and contextual evaluations for frontier AI labs and regulated European enterprises, leveraging Huzzle's vetted PhD/expert network. It bundles environments, human data, and evals in one stack.
Raised
$6M
Headcount
11-50
Founded
2020
SOC 2
Type II
Researchers
yes
Open src
partial
Backers: 10x Founders, Angel Invest, Emerge
CodeLong Horizon
site ↗
#3

Fleet AI

Commercial
Fleet AI builds high-fidelity reinforcement-learning training environments ('gyms') that replicate enterprise software such as Salesforce and Excel, plus browser/desktop workflows, so frontier AI labs and large enterprises can train and evaluate computer-use agents. It ships a Python SDK, a platform API, and the open-source 'Harbor' agent-evaluation/RL-environment tooling, pairing simulated environments with human supervision.
Raised
$15M
Headcount
11-50
Founded
2024
SOC 2
unknown
Researchers
yes
Open src
yes
Backers: Sequoia Capital, Menlo Ventures, SV Angel
Enterprise
site ↗
#4

Chakra Labs

Commercial
Chakra Labs runs Dojo, an open/collaborative reinforcement-learning environment hub for computer-use agents, offering deterministic, frame-accurate clones of production software plus human computer-use trajectory datasets, with native support for the Harbor, Verifiers and Verl RL frameworks. It positions itself as bringing frontier-lab-grade CUA training infrastructure to the broader research community.
Raised
$10.1M ↑ $10.1M
Headcount
11-50
Founded
2024
SOC 2
unknown
Researchers
yes
Open src
yes
Pedigree: Alexander Fung (co-founder), ex-Palantir, Snap/Snapchat, Fin; Compute
Computer Use
site ↗
#5

Andon Labs

Commercial
Andon Labs is a Y Combinator-backed (W24) startup, formerly Vectorview, building benchmarks and evaluations for AI agents' long-horizon coherence and safety (Vending-Bench, Butter-Bench, Blueprint-Bench) and operating real-world autonomous AI businesses. It is known for high-profile collaborations placing AI-run vending machines/stores in the offices of frontier labs Anthropic (Project Vend) and xAI (Grokbox).
Raised
$500K
Headcount
11-50
Founded
2023
SOC 2
unknown
Researchers
yes
Open src
?
Backers: Y Combinator (W24)
Computer UseLong Horizon
site ↗
#6

HUD

Commercial
HUD (YC W25, formerly hud.so) is a platform for building reinforcement-learning environments and evaluations for computer-use and browser agents. It lets teams wrap real software/code as agent-callable tools in isolated containers, define tasks and rewards, and run evals/RL at scale via an open-source SDK plus a cloud-hosted gateway. It maintains public benchmarks (OSWorld-Verified contributions, SheetBench-50) and positions frontier AI labs and agent-first startups as its target customers.
Raised
Headcount
11-50
Founded
2025
SOC 2
unknown
Researchers
yes
Open src
yes
Backers: Y Combinator (W25 batch), Exceptional Capital
Computer UseEnterprise
site ↗
#7

Halluminate

Commercial
Halluminate (YC S25, founded 2024, San Francisco) builds managed reinforcement-learning sandbox environments, simulated applications, and human/annotation data plus evaluation benchmarks (WebBench, BrowserBench, Westworld) to train and test computer-use and browser AI agents. Its 2026 site positioning has narrowed toward 'RL environments for financial services' (investment banking, private equity, consulting).
Raised
$160K
Headcount
1-10
Founded
2024
SOC 2
unknown
Researchers
yes
Open src
yes
Backers: Y Combinator (S25), Orange Collective, Antigravity Capital
Computer UseEnterprise
site ↗
#8

Matrices

Commercial
Matrices builds reinforcement-learning training environments for frontier AI labs to train agents that use computers and browsers like humans, described as a 'gamified replica of the internet' where thousands of agents learn via RL. The company frames its mission as 'towards self-driving computers' and says it helps labs train computer-use agents (Operator-class systems). Note: this is the correct browser-native entity (matrices.ai / LinkedIn 'matricesapp'), distinct from the similarly named 'Matrice.ai' computer-vision company and 'Matrix AI Network' blockchain project.
Raised
$5M
Headcount
11-50
Founded
2023
SOC 2
unknown
Researchers
?
Open src
no
Backers: Index Ventures, AI Grant (Nat Friedman & Daniel Gross), Naval Ravikant
Computer Use
site ↗
#9

BenchFlow

Commercial
BenchFlow is an early-stage, YC-backed open-source 'environment lab' building evaluation infrastructure and a community Benchmark Hub for AI agents, with products including SkillsBench, ClawsBench (mock workplace environments) and a sandboxed agent runtime. It positions environments as 'the new data' for training and evaluating agents across domains like enterprise workflows, coding, computer use and browser tasks.
Raised
$1.0M
Headcount
1-10
Founded
2024
SOC 2
unknown
Researchers
yes
Open src
yes
Backers: Y Combinator, Pear VC, Construct Capital
CodeComputer UseEnterprise
site ↗
#10

Collinear

Commercial
Collinear AI operates a 'Simulation Lab' (SimLab) that builds sandboxed, stateful RL environments simulating enterprise users, tools (Jira, ServiceNow, Shopify, EMR, airline/hotel systems) and multi-step workflows, producing training-ready trajectories, reward signals and evals for agentic models. It also offers synthetic post-training data and LLM-judge evaluation, positioning itself around 'environment-as-a-service' for enterprise long-horizon agents.
Raised
Headcount
11-50
Founded
2023
SOC 2
unknown
Researchers
yes
Open src
no
Backers: Engineering Capital, Firestreak Ventures, 112 Capital (11.2 Capital)
CodeComputer UseEnterprise
site ↗
#11

Refresh

Commercial
Refresh (YC X25) builds simulation engines / RL environments with verifiable rewards for coding and computer use, partnering with frontier labs and enterprises to train AI software-engineering and computer-use 'coworker' capabilities across terminal and GUI.
Raised
Headcount
1-10
Founded
2025
SOC 2
unknown
Researchers
yes
Open src
no
Backers: Y Combinator
CodeComputer Use
site ↗
#12

Plato

Commercial
Plato (plato.so, Plato Technologies, Inc.) builds simulated worlds for training and evaluating browser and computer-use agents, recreating real websites/software (e.g. Amazon/Airbnb/Gmail-style replicas) as reinforcement-learning environments with structured APIs for interaction, state tracking and scoring. It also offers a 'Computer Use' capability driving a full Linux desktop, positioning at the intersection of browser interaction and enterprise workflow simulation.
Raised
Headcount
1-10
Founded
2025
SOC 2
unknown
Researchers
yes
Open src
no
Pedigree: Pranav Putta (Co-founder/CTO), prior MultiOn, Georgia Institute of Te
Computer UseEnterprise
site ↗
#13

Habitat Inc

Commercial
Habitat Inc is an early-stage commercial vendor (2-10 employees, New York HQ) building reinforcement-learning environments for white-collar / work automation, with stated focus on code and desktop-style (computer use) interaction tasks for training agentic AI models. It appears in third-party listings of RL-environment suppliers serving AI labs. No funding, customer, or certification information is publicly available.
Raised
Headcount
1-10
Founded
?
SOC 2
unknown
Researchers
?
Open src
no
Pedigree: Maxim Enis (co-founder), Williams College '24; prior Ramp association
CodeComputer UseEnterprise
site ↗
n/r

Scale AI

Incumbent
Scale AI is the data-labeling and AI-data incumbent that has extended into RL environments, offering simulated web apps, macOS/Windows-like desktop VMs, and MCP-tool environments (Slack, HubSpot, Linear) with expert-designed objectives, rubrics, and automated verifiers to train and evaluate agents on long-horizon professional workflows. Following Meta's ~$14.3B June 2025 investment (~49% non-voting stake) and founder Alexandr Wang's departure to Meta, several frontier-lab customers (OpenAI, Google, xAI) reportedly scaled back or paused engagement over conflict-of-interest concerns.
Raised
$1.6B
Headcount
200+
Founded
2016
SOC 2
Type II
Researchers
yes
Open src
no
Backers: Meta Platforms, Accel, Amazon
CodeComputer UseEnterprise
site ↗
n/r

Daytona

Infrastructure
Daytona provides secure, elastic, programmatic sandboxes ('computers') that AI agents and developers can spin up in under ~90ms to run untrusted AI-generated code in isolated, stateful runtimes. It offers a managed-hosted service plus an open-source self-hostable stack, and is positioned as agent-native execution/runtime infrastructure for code execution, computer use, and RL/eval workloads.
Raised
$31M ↑ $24M
Headcount
11-50
Founded
2023
SOC 2
Type I
Researchers
?
Open src
yes
Backers: FirstMark Capital (Series A lead; Matt Turck joined board), Pace Capital, Upfront Ventures (seed lead, Series A participant)
CodeComputer Use
site ↗
acq

Deeptune

Commercial
Deeptune was a New York-based startup building managed reinforcement-learning environments ('training gyms') for computer-use and code, where AI agents practice and are evaluated on realistic digital knowledge-work tasks (simulating tools like Slack and Salesforce). It sold these pre-built environments primarily to frontier AI labs and raised a $43M Series A led by a16z (March 2026). In July 2026 it was acquired by Mercor; the team joined Mercor and Deeptune's environment platform now sits under Mercor. It is therefore no longer ranked as an independent vendor.
Raised
$43M
Headcount
11-50
Founded
2025
SOC 2
unknown
Researchers
yes
Open src
no
Backers: Andreessen Horowitz (a16z, lead), 776, Abstract Ventures
CodeComputer UseEnterprise
site ↗
n/r

E2B

Infrastructure
E2B provides open-source, secure cloud sandboxes (built on Firecracker microVMs) for running AI-generated code and AI agents, offered as a hosted API with BYOC/on-prem/self-hosted options. It positions as execution infrastructure for enterprise AI agents and self-claims broad Fortune 100 adoption.
Raised
$32M
Headcount
11-50
Founded
2023
SOC 2
Type II
Researchers
no
Open src
yes
Backers: Insight Partners (Series A lead), Decibel (seed lead), Sunflower Capital
CodeComputer Use
site ↗
n/r

Cua

Infrastructure
Cua (trycua, YC X25) is open-source MIT-licensed infrastructure for computer-use agents, providing cloud and self-hosted sandboxes across macOS, Windows, Linux, and Android plus an SDK, a virtualization layer (Lume), and a benchmarking/RL-eval suite (Cua-Bench). It positions itself as the 'Docker for computer-use agents,' giving any agent a cloud desktop.
Raised
$500K
Headcount
1-10
Founded
2025
SOC 2
unknown
Researchers
yes
Open src
yes
Backers: Y Combinator (X25 batch)
Computer Use
site ↗

More RL-environment categories