RL List.com
UPDATED 2026.10.05
rl-list.com · Vendors · Turing

Turing

Incumbent
medium confidence
www.turing.com ↗ · Status: active confirmed · Founded 2018

Turing is a large incumbent supplier of expert human data to frontier AI labs. It claims 5M+ experts and work with '9/9 frontier labs' (both self-claimed). In 2026 it moved further into verifiable agent environments and evaluations. It launched Turing Frontier in April, set up the Turing Frontier Research Lab, and published benchmarks including CyberStrike (Harbor format, public on Hugging Face), KernelQuest, CEO Bench, SciCode++ and PLSQLBench (with Oracle, per Turing). It also contributed tasks to Terminal-Bench 3.0 and hired a research-heavy CTO, Ece Kamar (ex-Microsoft Research).

Key facts
Headquarters
San Francisco, CA, USAconfirmed cite
Headcount band
200+reported
Total raised
$300Mconfirmed cite
Last round
Series E, $111M (2025-03-06)confirmed cite
SOC 2
unknown
What they sell
human data, expert networks, benchmarks/evaluations and verifier-graded agentic environments/datasets for frontier labsconfirmed cite
Open source
partialconfirmed cite
Deployment
unknown

What's new

12 sourced updates · last 6 months

Founding team

Jonathan Siddharth
Jonathan Siddharth
Co-Founder and CEO
Co-founder and CEO of Turing, listed as co-founder on the company leadership page.
Vijay Krishnan
Vijay Krishnan
Co-Founder and Head of Growth
Co-founder of Turing, now Head of Growth, according to the company leadership page.
Ece Kamar
Ece Kamar
Chief Technology Officer (since 2026-09)
Former Corporate VP leading the AI Frontiers Lab at Microsoft Research. Harvard CS PhD and a BS from Sabanci University. The company page spells her name 'Ece Kumar'; the official release uses 'Kamar'.
Robin Bordoli
Robin Bordoli
President and Global Chief Revenue Officer (since 2026-07)
Former CRO at Weights & Biases (through its acquisition by CoreWeave) and former CEO of Figure Eight (acquired by Appen). Earlier in go-to-market roles at Marketo and Jive Software. Stanford MBA and Cambridge MEng.

What practitioners should know

For researchers

  • The Turing Frontier Research Lab publishes benchmark write-ups with failure-mode analyses, such as the Terminal-Bench 3.0 confident-failure study and KernelQuest's rejection of shortcut runs.
  • Open release: CyberStrike on Hugging Face (CC BY-NC-ND 4.0, non-commercial, no derivatives). Turing says MMRL is on Hugging Face as TuringEnterprises/MMRL, but that page returned 401 when checked. Most other datasets, such as SciCode++, are proprietary, with samples on request.
  • SciCode++ includes a published post-training result: LoRA SFT on Qwen 3.5 9B gave +10.3% relative on SciCode.
  • PLSQLBench (arXiv 2608.15931) is described by Turing as joint research with Oracle.

For program managers

  • An incumbent at scale. The company page claims 5M+ domain experts and work with '9/9 frontier labs' (self-claimed). The recruiting homepage shows Anthropic, Gemini and Nvidia under 'Work With' (self-claimed logos).
  • Turing's site states $300M+ raised. The last round found is the $111M Series E (2025-03-06, outside this refresh window), and the opened pages name no investors or valuation. A January 2025 release headline reported a ~$300M revenue run-rate in a profitable year. Web search was unavailable, so newer funding press could not be checked.
  • Leadership expanded in 2026: Robin Bordoli (President/CRO, ex-W&B and ex-Figure Eight), Ece Kamar (CTO, ex-Microsoft Research AI Frontiers) and Patrick McKinney (CISO, ex-Invisible Technologies).

For data ops

  • CyberStrike ships in Harbor format: instruction.md, a containerized environment, deterministic tests with reward config, an oracle solution and task.toml metadata.
  • SDLCbench runs against MCP backend environments, and Turing contributes tasks to Terminal-Bench 3.0.
  • A CISO was appointed in 2026-09, but none of the pages opened mention SOC 2 or ISO certification, so this is still unverified.

Benchmarks & research

15 published
SciCode++dataset · 18 Sep 2026
Expert-reviewed, test-validated scientific coding dataset that extends SciCode (proprietary; samples on request).
LoRA SFT of Qwen 3.5 9B: +10.3% relative on SciCode, +9.1% on SciCode-Verified
CEO Benchbenchmark · 7 Sep 2026
Executive and departmental decision work inside one simulated company (Cirrus Sleep, Inc.), graded against expert-written rubrics.
Best model GPT-5.6 Terra averaged 41.3/100
KernelQuestbenchmark · Sep 2026
Agents write optimized Triton GPU kernels, graded through structural, correctness, policy and performance gates.
Claude Opus 5: 67.0% (±5.3) pass rate
Medical Benchbenchmark · Sep 2026
Longitudinal clinical reasoning over one dermatology patient's chart, read at nine points in time.
OdysseysMegabenchmark · Sep 2026
Long-horizon browser tasks on the live web, run by computer-use agents and judged rubric by rubric.
Benchmark of whether LLM systems can write executable PL/SQL, graded by execution-based tests. Turing describes it as Turing research in collaboration with Oracle; the arXiv page does not show affiliations.
Eight LLMs evaluated; consistent gaps in schema grounding, PL/SQL dialect fidelity, control flow, exception handling and cross-turn consistency
Turing wrote and verified some Terminal-Bench 3.0 tasks and published a failure analysis. Turing does not own the benchmark; the official leaderboard is at frontierbench.ai.
In 3,600 trials, almost all failures were well-formed artifacts with wrong content, and agents' self-verification repeated their own misreading of the task
CyberStrikebenchmark · Aug 2026
Cybersecurity agent benchmark covering defensive, offensive and DFIR tasks in Harbor containerized environments with deterministic verifiers. The dataset is public on Hugging Face (TuringFrontierResearchLab/CyberStrike, CC BY-NC-ND 4.0).
Top model GPT-5.6 Sol: 31.5% mean per-task pass rate
SDLCbenchbenchmark · Aug 2026
Long-horizon software-engineering work on private enterprise codebases, run against nine MCP backends (mail, calendar, chat, docs, spreadsheets, slides, PDF, file system, bash).
Leader Fable 5: 0.51 reward, 40% of tasks fully passed
EKWbenchbenchmark · Aug 2026
Multi-hour operational knowledge work such as sourcing reviews, cost roll-ups, assortment resets and referral triage.
Turing Terminal-Bench Datadataset · Jul 2026
Training set of expert-written terminal tasks graded by verifiers (ML, data analysis, scientific computing).
GPT-5.5 48.6%, Claude Opus 4.8 41.3%, Gemini 3.5 Flash 38.3%
Turing Frontier Agentic STEMdataset · Jul 2026
Training set of expert-written terminal tasks in the STEM sciences, graded by verifiers.
Claude Opus 4.8 43.7%, GPT-5.5 40.6%, Gemini 3.5 Flash 21%
CompanyBenchbenchmark · Jun 2026
Financial-analyst agent evaluation in a simulated consumer-fintech neobank.
Open-MM-RL (MMRL)dataset · May 2026
PhD-level multimodal STEM reasoning set with verifiable answers, built as an RL signal. Turing says it is on Hugging Face (TuringEnterprises/MMRL) and Turing DataHub, but the Hugging Face page returned 401 when checked, so it may be gated or not public.
Hub for Turing's benchmark dashboards and results.

Products

Turing Frontier ↗
Offering that connects AI labs with elite domain experts. Only the headline is verified; the full release returned 403.launched 9 Apr 2026
Turing Frontier Research Lab ↗
Research arm that publishes expert-written benchmarks and verifier-graded training datasets and environments for frontier agents.
Turing Benches ↗
Public dashboards for Turing's benchmarks (STEM, SWE, enterprise knowledge work, computer use).
Turing DataHub ↗
Distribution point for Turing datasets such as MMRL and SciCode, according to bench.turing.com.
Turing expert talent platform ↗
Portal that recruits domain experts and engineers for remote AI training and evaluation work.

Scale & velocity

Current headcount
unknown
Headcount growth
unknown
Open roles
unknown
Other locations
unknown
Distributed / remote
yesreported

Research depth

Has researchers
yesreported
Researcher count
unknown
Backgrounds
Microsoft Research (CTO Ece Kamar, ex-CVP AI Frontiers Lab), Harvard CS PhDconfirmed cite

Capital

Total raised
$300M+ (company-stated)confirmed cite
Last round
Series E, $111M (2025-03-06)confirmed cite
Investors
unknown
Valuation
unknown
Revenue signals
The company reported its annual revenue run-rate nearly tripled to $300M in a profitable year (press release 2025-01-28)confirmed cite

Security & compliance

SOC 2
unknown
Other certifications
unknown
Security page
unknown

Product

What they sell
human data, expert networks, benchmarks/evaluations and verifier-graded agentic environments/datasets for frontier labsconfirmed cite
Open source
partialconfirmed cite
License
CC BY-NC-ND 4.0 (CyberStrike dataset); other datasets proprietaryconfirmed cite
Deployment model
unknown
Maturity
GAreported
Notable customers
⚑Anthropic self-claimed ⚑Google (Gemini) self-claimed Nvidia self-claimed cite

Buyer analysis

Best fit: Buyers needing very large-scale human coding and reasoning data, expert labor, and evaluations over real codebases from an established incumbent rather than a focused environment startup.

How we verified this

2026-10-05 refresh: I opened and checked every draft item against primary pages: the turing.com company, press, research and blog pages, the three go.turing.com executive releases, bench.turing.com and its sub-pages, the Hugging Face dataset and org pages, and arXiv. Identity is confirmed: Turing, the AI training-data and expert-network company. The draft was mostly accurate, with these changes. I dropped the March 2025 Series E from funding_events because it falls outside the window, keeping it as last_round. I moved a GPT-5.4 pass@8 figure from MMRL to SciCode, where the source puts it. I corrected Bordoli's CoreWeave wording and named the SDLCbench leader as 'Fable 5'. I added PLSQLBench (arXiv 2026-08-16, which Turing says it built with Oracle), which the researcher missed. All four leadership headshots were downloaded and visually checked as single-person photos from turing.com/company. BusinessWire releases (Turing Frontier, Series E) returned 403, so the Turing Frontier launch is verified only by its headline and date. The MMRL Hugging Face page returned 401. Web search was exhausted, so third-party press on new funding, valuation or acquisitions in the window could not be checked. A round reported only in the press would be missed here.

Related vendors

Sources

  1. www.turing.com/company · 2026-10-05, Leadership team with headshots (Siddharth, Krishnan, Bordoli, Kamar, CFO, CLO), San Francisco PMB address, self-claimed 5M+ experts and 9/9 frontier labs
  2. www.turing.com/press · 2026-10-05, Press list: Turing Frontier (2026-04-09), Series E $111M (2025-03-06), $300M run-rate (2025-01-28), undated executive announcements; links to BusinessWire releases (403 when fetched)
  3. www.turing.com/ · 2026-10-05, Recruiting homepage: '$300M+ Raised from top VCs'; Anthropic, Gemini and Nvidia logos (self-claimed)
  4. go.turing.com/press/turing-names-ece-kamar-chief-technology-officer · 2026-10-05, CTO appointment, San Francisco, 2026-09-01
  5. go.turing.com/press/robin-bordoli-named-president-global-cro · 2026-10-05, President/CRO appointment, 2026-07-14
  6. go.turing.com/press/turing-names-patrick-mckinney-chief-information-secu · 2026-10-05, CISO appointment, 2026-09-09; no certifications named
  7. www.turing.com/blog · 2026-10-05, Blog index with 2026 benchmark posts (Aug-Sep 2026)
  8. www.turing.com/blog/cyberstrike-cybersecurity-benchmark-ai-agents · 2026-10-05, CyberStrike announcement (Aug 2026), Harbor format, GPT-5.6 Sol 31.5%
  9. huggingface.co/datasets/TuringFrontierResearchLab/CyberStrike · 2026-10-05, Dataset card: Harbor format, CC BY-NC-ND 4.0
  10. huggingface.co/TuringFrontierResearchLab · 2026-10-05, Hugging Face org page (one public dataset: CyberStrike; website labs.turing.com)
  11. www.turing.com/blog/kernelquest-benchmark-ai-agents-triton-kernels · 2026-10-05, KernelQuest, Claude Opus 5 67.0%
  12. www.turing.com/blog/ceo-bench-frontier-agents-real-company-work · 2026-10-05, CEO Bench (2026-09-07), GPT-5.6 Terra 41.3/100
  13. www.turing.com/blog/terminal-bench-3-confident-failure · 2026-10-05, Terminal-Bench 3.0 confident-failure analysis (2026-08-13)
  14. www.turing.com/blog/introducing-terminal-bench-3-0 · 2026-10-05, Turing's contributor role: 'some of the tasks authored and verified by our team'; leaderboard at frontierbench.ai
  15. www.turing.com/blog/scicode-plus-plus-scientific-coding-dataset · 2026-10-05, SciCode++ (2026-09-18), Qwen 3.5 9B post-training result
  16. www.turing.com/blog/frontier-ai-newsletter-84 · 2026-10-05, Newsletter introducing PLSQLBench as Turing research 'in collaboration with Oracle'
  17. arxiv.org/abs/2608.15931 · 2026-10-05, PLSQLBench paper, submitted 2026-08-16
  18. www.turing.com/research · 2026-10-05, Turing Frontier Research Lab datasets (July 2026) with model pass rates
  19. bench.turing.com/ · 2026-10-05, Benchmarks hub listing nine benchmarks with update dates
  20. bench.turing.com/open-mm-rl/ · 2026-10-05, Open-MM-RL / MMRL; says Hugging Face TuringEnterprises/MMRL and DataHub (Hugging Face page returned 401)
  21. bench.turing.com/sdlc/ · 2026-10-05, SDLCbench, nine MCP backends, Fable 5 leads at 0.51 reward
Last updated 2026-10-05 · Every quantitative field carries a source and a confidence tag. Fields we could not source publicly are marked unknown, never estimated. See the methodology.