RL List.com
UPDATED 2026.10.05
rl-list.com · Vendors · Surge AI

Surge AI

Incumbent
high confidence
surgehq.ai ↗ · Status: active confirmed · Founded 2020

Surge AI is a bootstrapped human-data and RLHF leader for frontier labs (reported $1.2B 2024 revenue). In 2026 it built a large in-house benchmark and RL-environment program (DAYJOB, GDP.pdf/.xlsx, HANDBOOK.md, Chartography, CoreCraft, and the Tuesday Work Index composite), published post-training transfer studies, launched Post-Training Runs and an enterprise offering, and released sample harnesses under Apache-2.0. Anthropic reports results on Surge's GDP.pdf in its Claude Sonnet 5 system card, and Microsoft publicly credits Surge's expert raters. OpenAI's adoption of GDP.pdf is so far claimed only by Surge.

Key facts
Headquarters
San Francisco, California, USAconfirmed cite
Headcount band
51-200confirmed cite
Total raised
$0reported cite
Last round
None disclosed. Bootstrapped. Reported July 2025 talks (~$1B at $15-25B+) have no disclosed close as of Oct 2026.reported cite
SOC 2
unknown
What they sell
mixedconfirmed cite
Open source
partialconfirmed cite
Deployment
managed-hostedestimated cite

What's new

14 sourced updates · last 6 months

Founding team

Edwin Chen
Founder and CEO
Previously a research scientist at Google, Facebook and Twitter (per his own site), and worked at Peter Thiel's hedge fund Clarium (per Forbes). Studied math, computer science and linguistics at MIT. Forbes lists him as the youngest member of The Forbes 400.

What practitioners should know

For researchers

  • In 2026 Surge has posted 11 arXiv papers, 9 of them between April and October. Recurring authors: Sushant Mehta, Suhaas Garre, Logan Ritchie and Liudas Panavas, with Edwin Chen. The papers cover benchmarks (Riemann-Bench, GDP.pdf, HANDBOOK.md, Chartography, DAYJOB) and transfer studies from RL on Surge environments.
  • Transfer claims, per the paper abstracts: office-work tasks gave +5.8 on SWE-Bench Pro; RL on 1,700 coding tasks took Terminal-Bench 2.1 from 67.4 to 82.0 (Kimi K2.7 Code); expert-rubric RLVR gave +15.5 pp on Qwen3-4B. All are vendor-run studies of the vendor's own data.
  • Anthropic's Claude Sonnet 5 system card says it 'was not able to reproduce Surge's reported numbers' on GDP.pdf. Its scores use a mean criteria pass rate, an Opus 4.7 judge and truncated (not dropped) PDFs, so they are not directly comparable to Surge's leaderboard.
  • Paper and live leaderboard scores can differ a lot. Chartography: 45.0% in the paper vs 71.6% live. Riemann-Bench: below 10% in the paper vs 74.4% live. Cite the source and date you use.

For program managers

  • Still bootstrapped. Forbes (profile, Oct 2026) says Surge claims no outside funding and that Chen owns about 75%. No round from the July 2025 talks has been disclosed.
  • Confirmed by primary sources: Microsoft (named as human-eval partner for MAI-Thinking-1, 2026-08-12) and Anthropic using GDP.pdf in the Claude Sonnet 5 system card (2026-06-30). Self-claimed by Surge: OpenAI's GPT-5.6 citation of GDP.pdf, the Riemann-bench citation in Anthropic's Fable 5 / Mythos 5 card, and running the human baseline for Anthropic's alignment study.
  • Surge now sells off-the-shelf RL environments, post-training runs and an enterprise eval/training offering alongside its expert workforce. The careers page includes RL Environments Architect and 'Senior Software Engineer, Agentic Coding RL Envs' roles.
  • The careers page lists 59 distinct role pages (accessed 2026-10-05). Most are remote; executive-assistant roles are tied to New York, San Francisco and Seattle.

For data ops

  • Open benchmark repos (dayjob, handbook, gdp-xlsx) are Apache-2.0. Per the repo READMEs, DAYJOB tasks use the Harbor layout (task.toml, instruction.md, environment/, tests/) with an OpenHands SDK harness. HANDBOOK.md uses Docker mock services and MCP servers.
  • Datasets live under the 'surgeai' Hugging Face org. 'surge-ai' on Hugging Face is an unrelated person.
  • Full task sets for DAYJOB and HANDBOOK.md are available by contacting benchmarks@surgehq.ai. Public repos contain samples only.
  • No public SOC 2 or trust page: surgehq.ai/security and /trust both return 404, and the enterprise page shows no compliance badges.

Benchmarks & research

18 published
DAYJOB (Healthcare, Finance)environment · 1 Oct 2026
130 long-horizon professional tasks (50 healthcare, 80 finance) in containerised Harbor environments with expert rubrics. Apache-2.0 harness at github.com/surge-ai/dayjob; full set on request.
Claude Opus 5.5: 24.7% healthcare, 23.9% finance
GDP.xlsxbenchmark · 1 Oct 2026
70 spreadsheet-reasoning tasks across 12 domains. Apache-2.0 repo plus a Hugging Face dataset (surgeai/GDP.xlsx).
Gemini 4 Argon: 38.3%
Kimi K2.7 Code: Terminal-Bench 2.1 from 67.4 to 82.0; SWE-Bench Pro from 60.1 to 64.8
Tuesday Work Indexleaderboard · 24 Sep 2026
Composite 'AI at work' score built from eight Surge benchmarks
Live leader: Claude Opus 5.5 at 83.9. Launch leader: Claude Fable 5 at 66.8.
Chartographybenchmark · 11 Aug 2026
100 professional chart-understanding tasks, tested on 30 model configurations
Paper: best 45.0% mean pass@1. Live leaderboard: Gemini 4 Argon 71.6%.
+5.8 pass@1 on SWE-Bench Pro from 363 office tasks (abstract)
+9.6 Toolathlon, +5.3 tau2-Bench, +5.8 SWE-Bench Pro (abstract)
HANDBOOK.mdenvironment · 28 Jul 2026
65 agentic tasks governed by 20 to 124 page policy documents across 5 enterprise domains. Apache-2.0 3-task sample at github.com/surge-ai/handbook.
Paper: best 36.2%. Live leaderboard: Claude Fable 5.1 38.8%.
ComplexConstraintsbenchmark · 8 Jun 2026
Benchmark for entangled instruction following, plus expert rubrics used for RLVR
Rubric RLVR on Qwen3-4B: +15.5 pp held-out. Live leaderboard: Claude Fable 5.1 77.4%.
Antidote leaderboardleaderboard · May 2026
Real-world leaderboard graded by experts (doctors, lawyers, engineers), positioned against LMArena
Live leader: Claude Fable 5 (Adaptive/High) at 1099 Elo
Riemann-Benchbenchmark · 8 Apr 2026
25 research-level math problems
Paper: all frontier models below 10%. Live leaderboard: GPT 5.6 Sol 74.4% (scoring basis not reconciled with the paper).
GDP.pdfbenchmark · Apr 2026
100 professional PDFs and prompts across ten fields. Reported in Anthropic's Claude Sonnet 5 system card.
Paper: best 30.7%. Live leaderboard: GPT 6 Astra 34.2%.
EnterpriseBench: CoreCraftenvironment · 18 Feb 2026
High-fidelity enterprise customer-support RL environment (2,500+ entities, 23 tools)
GLM 4.6 went from 25.37% to 36.76% after one epoch of training
150 workplace tasks in a Surge e-commerce RL environment (blog post first published 2025-11)
Even the best models fail about 40% of tasks
Expert-annotated preference pairs (1,000 per task across four tasks). Surge's role is self-claimed via its research page.
Gemini 3 Pro 75-80% accuracy vs >90% for humans
1,600+ expert-curated prompts with rubrics. Surge lists it on its research page; its contribution is not stated in the abstract.
RIFL: 6.7% absolute gain on AdvancedIF
8.5K grade-school math word problems. Surge lists this OpenAI paper among its research contributions.
Hemingway-benchleaderboard
AI writing leaderboard built from 5,000+ blind pairwise judgments by professional writers and editors
Launch top: Gemini 3 Flash. Live leader: Claude Fable 5 at 1110 Elo.

Products

Off-the-shelf frontier data and RL environments ↗
Homepage headline offering: 'New Frontier data and RL environments, off the shelf'.
Post-Training Runs ↗
'We train frontier models on Surge datasets, then study what they learn.' Published runs use Kimi K2.7, Qwen3.5-122B-A10B, Qwen3-4B-Thinking, GLM-4.7 and GLM-4.6, with experiments dated May to September 2026. Results are Surge's own and name no customers.
Enterprise (Evaluate / Improve / Train) ↗
'Frontier Data for Enterprise': custom benchmarks and production monitoring, diagnosis of system bottlenecks, and training on company-specific workflows. The page shows no customer logos or compliance badges.
Expert Workforce / human data (RLHF, evaluations) ↗
Core managed human-data service using expert raters. Example: the blind side-by-side human evals for Microsoft's MAI-Thinking-1.
Surge benchmark suite and leaderboards ↗
Public leaderboards: Tuesday Work Index, DAYJOB, GDP.pdf/.xlsx, Chartography, HANDBOOK.md, ComplexConstraints, Riemann-bench, EnterpriseBench CoreCraft, Antidote, Hemingway-bench. Some full task sets are available on request via benchmarks@surgehq.ai.
surge-python SDK / Surge API ↗
MIT-licensed Python SDK for the Surge AI API.

Scale & velocity

Current headcount
~110-121 full-time employees (2025); ~1M annotators/contractorsreported cite
Headcount growth
unknown
Open roles
59reported cite
Other locations
New York, NY, Seattle, WAestimated cite
Distributed / remote
yesreported cite

Research depth

Has researchers
yesconfirmed cite
Researcher count
unknown
Backgrounds
Founder/CEO Edwin Chen: former research scientist at Google, Facebook and Twitter; formerly at Clarium Capital; studied math, CS and linguistics at MIT, Recurring authors on 2026 papers: Sushant Mehta, Suhaas Garre, Logan Ritchie, Liudas Panavas (backgrounds not disclosed). DAYJOB lists domain-expert co-authors from healthcare and finance.reported cite

Capital

Total raised
$0 outside funding (bootstrapped), per Surge's claim reported by Forbes as of Oct 2026. The July 2025 raise talks have no disclosed close.reported cite
Last round
None disclosed. Bootstrapped. Reported July 2025 talks (~$1B at $15-25B+) have no disclosed close as of Oct 2026.reported cite
Investors
unknown
Valuation
~$25B (reported July 2025 fundraise talks; 'at least $25B' per Bloomberg, '>$15B' per Reuters); unconfirmed/not closedreported cite
Revenue signals
$1.2B revenue (2024); ~$1.4B ARR claimed (Aug 2025, weak source)reported cite

Security & compliance

SOC 2
unknown
Other certifications
unknown
Security page
unknown

Product

What they sell
mixedconfirmed cite
Open source
partialconfirmed cite
License
Apache-2.0 (benchmark repos dayjob, handbook, gdp-xlsx); MIT (surge-python SDK); full datasets and environments proprietaryconfirmed cite
Deployment model
managed-hostedestimated cite
Maturity
GAestimated cite
Notable customers
⚑Anthropic verified ⚑Google verified ⚑Meta verified ⚑Microsoft (Microsoft AI; MAI-Thinking-1 human evals, named by Microsoft) verified ⚑OpenAI (former; relationship reportedly ended Sept 2025) verified cite

Buyer analysis

Best fit: Frontier and enterprise teams that need expert human data or evals, plus off-the-shelf long-horizon professional RL environments (healthcare, finance, office/policy, spreadsheets, coding), optionally with Surge-run post-training.

How we verified this

2026-10-05 refresh: Opened every source in the draft. All nine 2026-window arXiv IDs plus 2601.09032 and 2602.16179 were checked against the arXiv API and abstract pages. Titles, dates and authors (Mehta, Garre, Ritchie, Panavas, Chen) match. Two numbers were wrong: the office-work gain is 5.8, not 5.7, and the AdvancedIF gain is +8.4/8.45. Microsoft's MAI-Thinking-1 post confirms Surge verbatim (2026-08-12, 1,276 tasks). The biggest upgrade: I downloaded Anthropic's Claude Sonnet 5 System Card (2026-06-30). It reports GDP.pdf as 'from Surge AI' and states that Anthropic could not reproduce Surge's numbers, so the Anthropic GDP.pdf citation is now primary-confirmed. The Riemann-bench citation, OpenAI's GPT-5.6 citation (page returned 403) and Surge's role in Anthropic's alignment study stay self-claimed; Anthropic's study confirms the 28-researcher figure but not Surge's role. Corrections: the Tuesday Work Index launch figures (the draft had confused them with ComplexConstraints), the Hemingway and Riemann headlines (live scores differ a lot from the papers), the 'Meta x Surge' labels, the open-role count (59 unique postings), the locations confidence, and the customers-field confidence. Surge blog dates are unreliable because many pages show a 2026-09-16 re-render date, so arXiv or primary dates were used and approximate months are flagged. Added the April GDP.pdf launch and the ~May Antidote launch. Edwin Chen's GitHub avatar is a stylised graphic, not a verifiable headshot, so photo_url was blanked. His profile link now points to his verified personal site. Funding: none in the window; Forbes says Surge claims no outside funding. A news sweep (Google News and Bing RSS) found no acquisition, layoff or round. One possibly material lead, an Aug 2026 Forbes piece on US data vendors selling to Chinese labs, could not be opened and was not included.

Related vendors

Sources

  1. surgehq.ai/research · 2026-10-05, List of Surge papers and benchmarks with arXiv links
  2. surgehq.ai/ · 2026-10-05, Homepage offerings: off-the-shelf data and RL environments, post-training runs, workforce, enterprise
  3. surgehq.ai/post-training · 2026-10-05, Post-Training Runs offering and models used
  4. surgehq.ai/enterprise · 2026-10-05, Enterprise offering; no compliance badges or logos
  5. surgehq.ai/careers · 2026-10-05, 59 unique role pages; RL Environments Architect; EA roles in NY/SF/Seattle
  6. surgehq.ai/benchmarks · 2026-10-05, Live Tuesday Work Index (Claude Opus 5.5 83.9) and per-benchmark leaderboards
  7. surgehq.ai/benchmarks/riemann-bench · 2026-10-05, Live Riemann leaderboard (GPT 5.6 Sol 74.4%)
  8. surgehq.ai/benchmarks/gdp-pdf · 2026-10-05, Live GDP.pdf leaderboard (GPT 6 Astra 34.2%, GPT 5.6 Sol 30.7%)
  9. surgehq.ai/benchmarks/chartography · 2026-10-05, Live Chartography leaderboard (Gemini 4 Argon 71.6%)
  10. surgehq.ai/benchmarks/handbook · 2026-10-05, Live HANDBOOK.md leaderboard (Claude Fable 5.1 38.8%)
  11. surgehq.ai/benchmarks/antidote · 2026-10-05, Live Antidote leaderboard (Claude Fable 5 1099)
  12. surgehq.ai/benchmarks/hemingway-bench · 2026-10-05, Live Hemingway leaderboard (Claude Fable 5 1110)
  13. surgehq.ai/blog/tuesday-frontier-work-index · 2026-10-05, Tuesday Work Index launch; 8 components; launch leader Claude Fable 5 at 66.8
  14. surgehq.ai/blog/gdp-xlsx · 2026-10-05, GDP.xlsx launch: 70 tasks, 12 domains, Gemini 4 Argon 38.3%
  15. surgehq.ai/blog/dayjob · 2026-10-05, DAYJOB description and GDPval comparison
  16. surgehq.ai/blog/gdp-pdf-can-100b-ai-models-master-the-documents-that-run · 2026-10-05, GDP.pdf launch (April 2026)
  17. surgehq.ai/blog/introducing-antidote · 2026-10-05, Antidote launch, expert graders, LMArena critique
  18. surgehq.ai/blog/hemingway-bench-ai-writing-leaderboard · 2026-10-05, Hemingway-bench; launch top model Gemini 3 Flash
  19. surgehq.ai/blog/complexconstraints-a-benchmark-for-entangled-instruction · 2026-10-05, Qwen3-4B rubric RLVR results
  20. surgehq.ai/blog/chartography · 2026-10-05, Chartography release
  21. surgehq.ai/blog/handbook-md · 2026-10-05, HANDBOOK.md release
  22. surgehq.ai/blog/enterprisebench-corecraft · 2026-10-05, CoreCraft; GLM 4.6 25.37% to 36.76%
  23. surgehq.ai/blog/rl-envs-real-world · 2026-10-05, Hierarchy of Agentic Capabilities blog post
  24. surgehq.ai/blog/openai-gpt-5-6-gdp-pdf-benchmark · 2026-10-05, Surge's claim that OpenAI cited GDP.pdf; OpenAI page returned 403
  25. surgehq.ai/blog/anthropic-fable-5-mythos-5-cites-surge-benchmarks · 2026-10-05, Surge's claim of a Fable 5 / Mythos 5 system-card citation of GDP.pdf and Riemann-bench
  26. www-cdn.anthropic.com/480e0bb54327b9622282e9c39a83a4f490ed377e/Claude%20 · 2026-10-05, Claude Sonnet 5 System Card (2026-06-30), section 8.10.1: GDP.pdf 'from Surge AI'; reproducibility caveat; no Riemann mention
  27. surgehq.ai/blog/anthropic-automated-alignment-research · 2026-10-05, Surge's claim that it ran the 28-researcher human baseline
  28. www.anthropic.com/research/automated-researchers-mitigate-alignment-fail · 2026-10-05, Anthropic announcement dated 2026-08-28; 28 human safety researchers; does not name Surge
  29. surgehq.ai/blog/surge-human-evaluation-mai-thinking-1 · 2026-10-05, Surge post on the Microsoft evals (1,276 tasks)
  30. microsoft.ai/news/introducing-mai-thinking-1/ · 2026-10-05, Microsoft names Surge as its human-eval partner (2026-08-12)
  31. export.arxiv.org/api/query?id_list=2604.06802,2606.09118,2607.11192,2607 · 2026-10-05, arXiv metadata: dates, authors, abstract figures
  32. arxiv.org/abs/2601.09032 · 2026-10-05, Hierarchy of Agentic Capabilities, submitted 2026-01-13
  33. arxiv.org/abs/2511.10507 · 2026-10-05, AdvancedIF
  34. arxiv.org/abs/2512.16899 · 2026-10-05, Multimodal RewardBench 2 (Meta FAIR authors)
  35. github.com/surge-ai · 2026-10-05, Public repos, licenses and update dates
  36. github.com/surge-ai/dayjob · 2026-10-05, Apache-2.0; Harbor task layout; OpenHands SDK; Claude Opus 4.8 agentic judge via OpenCode
  37. github.com/surge-ai/handbook · 2026-10-05, Apache-2.0; 3-task sample; full set via benchmarks@surgehq.ai
  38. huggingface.co/surgeai · 2026-10-05, Surge's real HF org (huggingface.co/surge-ai is an unrelated individual)
  39. github.com/echen · 2026-10-05, Edwin Chen's GitHub ('Founder at Surge AI', NYC). Avatar is a stylised graphic, not used as a headshot
  40. www.edwinchen.ai · 2026-10-05, Edwin Chen's personal site: founder and CEO; prior Google/Facebook/Twitter; MIT
  41. www.forbes.com/profile/edwin-chen/ · 2026-10-05, No outside funding (company claim); ~75% stake; $18B; youngest Forbes 400 member; Clarium
  42. en.wikipedia.org/wiki/Surge_AI · 2026-10-05, Background; no 2026 events recorded
  43. news.google.com/rss/search?q=%22Surge+AI%22+funding&hl=en-US&gl=US&ceid= · 2026-10-05, News sweep for 2026-04 to 2026-10: no funding, acquisition or layoff stories, only aggregator re-reports (GetLatka, Dealroom)
  44. surgehq.ai/blog/anthropic-surge-ai-rlhf-platform-train-llm-assistant-hum · 2026-06-07, Verified Anthropic relationship; quote from co-founder Jared Kaplan
  45. sacra.com/c/surge-ai/ · 2026-06-07, Revenue/funding context; bootstrapped, ~12 frontier-lab customers
  46. www.bloomberg.com/news/articles/2025-07-30/scale-rival-surge-ai-in-talks · 2026-06-07, July 2025 talks ~$1B at $25B+ valuation
  47. getlatka.com/companies/surgehq.ai · 2026-06-07, ~$1.4B ARR reported Aug 2025 (third-party estimate)
  48. www.linkedin.com/company/surge-ai · 2026-06-07, Public LinkedIn band 51-200 employees; SF HQ; founded 2020
  49. pitchbook.com/profiles/company/472331-53 · 2026-06-07, Alternative headcount figure (~250) - conflicts with LinkedIn/Wikipedia
Last updated 2026-10-05 · Every quantitative field carries a source and a confidence tag. Fields we could not source publicly are marked unknown, never estimated. See the methodology.