RL List.com
UPDATED 2026.10.05
rl-list.com · Vendors · Vals AI
#8

Vals AI

Commercial
high confidence
www.vals.ai ↗ · Status: active confirmed · Founded 2023

Vals AI is an independent, a16z-backed third-party evaluator. It benchmarks frontier models and AI applications on economically valuable professional work (finance, legal, tax, coding, healthcare) and, since 2026, on frontier risks (recursive self-improvement, cyber, child safety). It publishes the Vals Index and more than 20 proprietary leaderboards, open-sources its Valkyrie eval infrastructure, offers the self-serve Vals Smith for custom coding benchmarks, and runs a public-sector practice from Washington, DC.

Key facts
Headquarters
San Francisco, USAreported cite
Headcount band
11-50reported cite
Total raised
$40Mconfirmed cite
Last round
Series A, $40M, 2026-08-13, led by a16zconfirmed cite
SOC 2
unknown (the SOC… cite
What they sell
evalsconfirmed cite
Open source
yes: Valkyrie eval infrastructure (AGPL-3.0); model-library, finance-agent, finance-agent-v2, legal-research-bench and web-search-agent-public (MIT); plus proof-bench, ioi-agent and benchmark-service repos. Core benchmark test sets are largely private.confirmed cite
Deployment
Public leaderboards at vals.ai; self-serve Vals Smith (connects through GitHub); evaluation infrastructure through Valkyrie (Vals-hosted or self-hosted on AWS, CLI/SDK); public-sector evaluationsconfirmed cite

What's new

14 sourced updates · last 6 months

Founding team

Rayan Krishnan
Rayan Krishnan
Co-founder & CEO
Left Stanford's master's program in AI to start Vals AI (TechTimes, 2024). Authored the Series A and Public Sector posts and co-authored the Finance Agent Benchmark paper (arXiv:2508.00828). The CEO title comes from the prior record; the sources opened here call him co-founder without a title.
Langston Nashold
Co-founder & CTO
Stanford master's program in AI; QA-Financial (Aug 2024) names him CTO and founder. Co-author of the Finance Agent Benchmark paper (arXiv:2508.00828). a16z's Series A post names him as a founder.
Glenn Parham
Glenn Parham
Head of Public Sector
Joined to lead Vals Public Sector (July 2026). Previously worked on AI for national security at the Pentagon and in big tech, per the Vals memo. Co-authored the Child AI Safety post.

What practitioners should know

For researchers

  • Publishes many open methodology posts. Recent ones cover benchmark cheating and shortcut-seeking (SWE-bench Verified, Terminal-Bench 2.1), AI-detector robustness, multi-turn teen-safety failures, and agent-produced Lean proofs (Thomson N=7, C-HD shortest path).
  • Open source: Valkyrie eval infrastructure (AGPL-3.0), plus MIT-licensed model-library, finance-agent, finance-agent-v2, legal-research-bench and web-search-agent-public. Also proof-bench, ioi-agent and benchmark-service skeletons for SWE-bench and Terminal-Bench.
  • Finance Agent Benchmark paper: arXiv:2508.00828. The dataset is on Hugging Face (vals-ai/finance_agent_benchmark).
  • Collaborators named on official pages: Stanford SALT Lab (Diyi Yang, Valerie Chen) and Stanford Psychiatry, CoreWeave and Marimo (RSI Index), Code for America and Center for Civic Futures, Harvey (partner benchmark), and Exa, Keenable, Parallel and Tavily (Web Search Index).

For program managers

  • Raised a $40M Series A at a $400M valuation led by a16z (2026-08-13), confirmed by both the company and a16z. Self-reported: 2026 revenue is 8x all of 2025, the customer base doubled, and the team tripled in six months.
  • Self-claimed frontier-lab ties: Vals says its results have been cited in model cards from OpenAI, Anthropic, Google, Meta and xAI. These are citations, not stated paying contracts.
  • Positioned as an independent third-party evaluator, now including frontier risk (RSI Index, SRE Bench and CyberBench, child and teen safety). Has a public-sector arm led by Glenn Parham out of a Washington, DC office. No agency customers are named.
  • Says it has supported the Department of Commerce and members of Congress on AI policy (self-claimed).

For data ops

  • Valkyrie can be Vals-hosted or self-hosted on AWS. It is driven by a CLI and Python SDK, with agents defined in contract.yaml.
  • Vals Smith connects to public or private repos through GitHub sign-in. Vals says code 'never leaves your control' and other services cannot access your data (vendor claim).
  • Security: a Vulnerability Disclosure Program has been in effect since 2026-08-31 (security@vals.ai). The redesigned site shows no SOC 2 or GDPR claims, and no trust center was found.

Benchmarks & research

13 published
Vals Index (v2.1)leaderboard · 2 Oct 2026
GDP-weighted index of agentic performance on finance, coding, legal and tax tasks (8 constituent benchmarks: 6 private, 2 public). Relaunched as part of 'Vals 2.0' in Aug 2026.
Gemini 4 Argon 68.90%, Claude Sonnet 5.5 67.04%, Claude Opus 5.5 66.97% (as of 2026-10-02)
Web Search Indexbenchmark · 2 Oct 2026
Compares agent search tools on expert-written legal and finance tasks. Partners: Exa, Keenable, Parallel, Tavily. The leaderboard is at /benchmarks/web_search.
No search: 2.9% legal / 7.4% finance; with search: roughly 30-50%
Entry-level financial analyst tasks on public filings. v1: arXiv:2508.00828 (537 questions; Bigeard, Nashold, Krishnan, Wu). v2: 927 expert-reviewed questions. Code is at github.com/vals-ai/finance-agent and github.com/vals-ai/finance-agent-v2 (both MIT).
Gemini 4 Argon 65.40% on v2 (as of 2026-10-01)
Agentic legal benchmark written by Harvey and evaluated by Vals.
Muse Spark 1.2 25.42% task pass rate (as of 2026-10-01)
Legal Research Benchbenchmark · 1 Oct 2026
Multi-source US legal research tasks graded all-pass against expert rubrics. Evaluation partners: Fisher Phillips, McDermott Will & Emery, Reed Smith, Legal Technology Hub. Code: github.com/vals-ai/legal-research-bench (MIT).
Three-way tie at 55.29% (Muse Spark 1.3 Max, Claude Opus 5, Claude Fable 5.1) as of 2026-10-01
AI detection benchmarkbenchmark · 30 Sep 2026
Adversarial evaluation of commercial AI-text detectors and frontier models on private writing from before Nov 2022.
Claude Opus 5.5 98.38% balanced accuracy
648 simulated teen conversations across 9 model APIs, run with Stanford SALT Lab and Stanford Psychiatry.
27.5% of conversations had at least one serious safety failure
Vals RSI Indexbenchmark · 13 Aug 2026
Measures progress toward recursive self-improvement with four autonomous LLM R&D tasks (compression, LM training, harness engineering, post-training). Built with CoreWeave (compute) and Marimo (notebooks).
Claude Opus 5.5 leads at 37.31% (as of 2026-10-01)
SRE Benchbenchmark · 13 Aug 2026
Contamination-free benchmark for reverse-engineering binaries without source code, co-developed with cybersecurity faculty and experts (not named).
GPT-6 Astra 56.87% (as of 2026-09-29)
Excel Modeling Benchmark (EMB)benchmark · 1 Jul 2026
Agents build full financial models in Excel (LBO, DCF, M&A, operating models, comps and more), checked against expert reference workbooks. The test set is private.
Claude Fable 5.1 76.67% (as of 2026-10-01); Claude Opus 4.8 69.4% at launch (reported)
Public Benefits Bench (v1.1)benchmark · 9 Jun 2026
SNAP benefits guidance across all 50 states plus Guam and the Virgin Islands, built with Center for Civic Futures and Code for America.
Claude Opus 5 76.93%; Vals concludes no general-purpose model is reliable enough for SNAP guidance
Vals Legal AI Report (VLAIR)benchmark · Feb 2025
Benchmark of legal AI products, run with a consortium of law firms.
The full benchmark directory. Vals also runs academic benchmarks (LegalBench, Terminal-Bench 4.0, Terminal-Bench Science, ProgramBench, SkillsBench, IOI, GPQA, MMLU Pro, MMMU Pro). Archived: CaseLaw v2, CorpFin v2, TaxEval v2, MortgageTax, MedQA, SWE-bench Verified, Terminal-Bench 2.0/2.1 and others.

Products

Vals Index and public benchmark leaderboards ↗
Independent public evaluations of frontier models across finance, legal, coding, tax, healthcare, math, science and frontier risk, including industry-partner benchmarks.
Vals Smith ↗
Self-serve tool that turns a GitHub repo's merged PRs into a custom coding benchmark with hidden tests. Users sign in with GitHub and can pick public or private repos. Launched with 120 free credits.launched 13 Aug 2026
Valkyrie (open source) ↗
Cloud-native infrastructure for running AI agent evaluations on any benchmark (AGPL-3.0). Runs Vals-hosted or self-hosted on AWS, with a CLI and Python SDK; agents are defined by contract.yaml. Docs at docs.valkyrie.vals.ai.
model-library (open source) ↗
Simple, provider-agnostic LLM gateway (MIT).
Vals Public Sector ↗
Independent AI evaluation for government agencies; includes Public Benefits Bench.launched 2 Jul 2026
Application Reports ↗
Evaluations of specific AI applications (e.g., Alexi).

Scale & velocity

Current headcount
~27 employees (Tracxn, as of July 2026; aggregator). The company says the team tripled in the six months to Aug 2026.reported cite
Headcount growth
Team tripled in the six months before Aug 2026 (company statement); actively hiringconfirmed cite
Open roles
unknown
Other locations
Washington, DCconfirmed cite
Distributed / remote
unknown

Research depth

Has researchers
yesreported
Researcher count
unknown
Backgrounds
Co-founder/CEO Rayan Krishnan - left Stanford's AI master's program to start Vals, Co-founder/CTO Langston Nashold - Stanford AI master's program, Glenn Parham - Head of Public Sector (previously AI for national security at the Pentagon and in big tech), Rez Havaei - founding engineer per TechTimes (2024); QA-Financial (2024) calls him a co-founder; current status unverified, Research staff publishing on the blog: Daniel Fein, Andrea Mock, Nikil Ravi, Geby Jaff, Hung Tran, Olivia Fowler, Omar Almatov, Collaborators: Stanford SALT Lab (Diyi Yang, Valerie Chen), Stanford Psychiatry (Eric Lin, MD), Caroline Figueroa (teen-safety co-author)confirmed cite

Capital

Total raised
$40M Series A (Aug 2026) disclosed. Earlier pre-seed/seed money from 8VC, Pear VC and Bloomberg Beta is confirmed but the amounts are not; aggregators' earlier '$5M seed' figure remains unverified.confirmed cite
Last round
Series A, $40M, 2026-08-13, led by a16zconfirmed cite
Investors
Andreessen Horowitz (a16z), 8VC, Pear VC, Bloomberg Beta, HRT Ventures, Next Ladder Venturesconfirmed cite
Valuation
$400M (Series A, Aug 2026; company-stated)confirmed cite
Revenue signals
Company says 2026 revenue is up 8x compared with all of 2025 and its customer base has doubled (self-reported, Aug 2026). No absolute figure is disclosed.confirmed cite
DateRoundAmountLed by
13 Aug 2026Series A$40M
valuation $400M
Andreessen Horowitz (a16z)source ↗

Security & compliance

SOC 2
unknown (the SOC 2 badge previously on /product is gone after the redesign; no audit report or trust center published) cite
Other certifications
unknown cite
Security page
https://www.vals.ai/vulnerability-disclosure-program (Vulnerability Disclosure Program, effective 2026-08-31; no trust center or certifications listed)confirmed cite

Product

What they sell
evalsconfirmed cite
Open source
yes: Valkyrie eval infrastructure (AGPL-3.0); model-library, finance-agent, finance-agent-v2, legal-research-bench and web-search-agent-public (MIT); plus proof-bench, ioi-agent and benchmark-service repos. Core benchmark test sets are largely private.confirmed cite
License
AGPL-3.0 (Valkyrie); MIT (finance-agent, finance-agent-v2, model-library, legal-research-bench)confirmed cite
Deployment model
Public leaderboards at vals.ai; self-serve Vals Smith (connects through GitHub); evaluation infrastructure through Valkyrie (Vals-hosted or self-hosted on AWS, CLI/SDK); public-sector evaluationsconfirmed cite
Maturity
GA; Series A company with a broad public leaderboard suite and a generally available self-serve product (Vals Smith)confirmed cite
Notable customers
⚑OpenAI (Vals says its results were cited in OpenAI model cards) self-claimed ⚑Anthropic (Vals says its results were cited in Anthropic model cards) self-claimed ⚑Google (Vals says its results were cited in Google model cards) self-claimed ⚑Meta (Vals says its results were cited in Meta model cards) self-claimed ⚑xAI (Vals says its results were cited in xAI model cards) self-claimed Harvey (industry-partner benchmark run by Vals; partner, not a stated customer) self-claimed Exa, Keenable, Parallel, Tavily (Web Search Index partners) self-claimed CoreWeave (RSI Index compute collaborator) self-claimed Code for America and Center for Civic Futures (Public Benefits Bench partners) self-claimed Fisher Phillips, McDermott Will & Emery, Reed Smith, Legal Technology Hub (Legal Research Bench evaluation partners) self-claimed US Department of Commerce (Vals says it supported Commerce's AI policy work) self-claimed cite

Buyer analysis

Best fit: Buyers who need neutral, domain-specific (legal/finance/healthcare) benchmarking and ongoing evaluation of LLM applications on their own data and tasks.

How we verified this

2026-10-05 refresh: I opened every source in the draft. For Vals itself I used the canonical /blogs/ URLs, the blog RSS feed for exact dates, the benchmark pages, the GitHub API for repo licenses and creation dates, and the author images. The core facts hold up: - **Series A:** $40M at a $400M valuation, led by a16z, with 8VC, Pear VC and Bloomberg Beta (existing) and HRT Ventures and Next Ladder Ventures (new). a16z's own 'Investing in Vals' post and Pear's portfolio listing confirm it independently. - **Public Sector:** launched with a DC office and Glenn Parham as Head of Public Sector. - **Research posts:** the published figures in the cheating, AI-detector, teen-safety, environmental-impact and Thomson-proof posts match what Vals published. Corrections: - **Dates:** several news items were dated by a leaderboard's 'last updated' date rather than its release. RSI Index and SRE Bench actually shipped with the Series A on 2026-08-13; Finance Agent v2 and Harvey's benchmark are reworded as leaderboard updates. - **NYT claim:** the NYT 'cites Vals' claim was softened because the article could not be opened. - **Partners:** all partner organisations are now marked self-claimed, since they are named only on Vals' pages and not as paying customers. - **Terminal-Bench 4.0:** moved out of the Vals-built benchmark list, because Vals lists it as an academic benchmark. - **Unsupported claims removed:** an absence claim about Harbor/MCP support and the 'since June' open-sourcing claim for Valkyrie. Additions: the Public Benefits Bench study (2026-06-09), Politico coverage of the teen-safety study, the Legal Research Bench law-firm partners, Tracxn's July 2026 headcount, and Glenn Parham with a verified headshot. Photos: both Rayan Krishnan's and Glenn Parham's photos are served from vals.ai with alt text naming them, and were checked visually. No verifiable photo was found for Langston Nashold. Rayan Krishnan's CEO title comes from the prior record; the sources opened here confirm only that he is a co-founder. Web search quota ran out partway through, so I used Google News RSS and direct page fetches to look for missed items.

Related vendors

Sources

  1. www.vals.ai/blogs/series-a · 2026-10-05, Series A ($40M at $400M, led by a16z); investors; growth claims; Vals Smith GA with 120 free credits; RSI Index and SRE Bench release; model-card and Department of Commerce claims; Rayan Krishnan author photo
  2. a16z.com/announcement/investing-in-vals/ · 2026-10-05, a16z's 'Investing in Vals' post (2026-08-13), naming founders Rayan Krishnan and Langston Nashold
  3. pear.vc/companies/ · 2026-10-05, Pear VC portfolio lists Vals AI, 'Pre-seed to Series A'
  4. www.finsmes.com/2026/08/vals-ai-raises-40m-in-series-a-funding-at-400m-v · 2026-10-05, Press coverage of the Series A; co-founders Krishnan and Nashold
  5. tracxn.com/d/companies/vals-ai/__Aeq7C2n56rLfgsWjTrbrPIwiOteKWlKhIWYPbap · 2026-10-05, Aggregator: Series A Aug 2026; ~27 employees as of July 2026
  6. www.vals.ai/blogs/rss.xml · 2026-10-05, Blog RSS with exact post dates (Jul-Oct 2026)
  7. www.vals.ai/blogs · 2026-10-05, Blog index with authors
  8. www.vals.ai/news · 2026-10-05, Press page: NYT (09/30), Bloomberg (09/14), Politico (09/29), Washington Post (09/23), Let's Data Science (07/03)
  9. www.youtube.com/watch?v=MpYAoufS588 · 2026-10-05, Bloomberg Tech segment 'Can Independent Testing Make AI Safer?' (title confirmed through oEmbed)
  10. www.vals.ai/home · 2026-10-05, Homepage: latest evaluations, Web Search Index partners
  11. www.vals.ai/about · 2026-10-05, About: independent evaluator; Valkyrie and Model Library open source
  12. www.vals.ai/benchmarks · 2026-10-05, Full benchmark directory (proprietary, academic, industry partner, archived)
  13. www.vals.ai/benchmarks/vals_index · 2026-10-05, Vals Index v2.1
  14. www.vals.ai/benchmarks/rsi_index · 2026-10-05, RSI Index; CoreWeave and Marimo
  15. www.vals.ai/benchmarks/srebench · 2026-10-05, SRE Bench
  16. www.vals.ai/benchmarks/fabv2 · 2026-10-05, Finance Agent v2
  17. www.vals.ai/benchmarks/hlab · 2026-10-05, Harvey's Legal Agent Benchmark (industry partner)
  18. www.vals.ai/benchmarks/emb · 2026-10-05, Excel Modeling Benchmark, current leaderboard
  19. www.vals.ai/benchmarks/public-benefits-bench · 2026-10-05, Public Benefits Bench v1.1; study first published 2026-06-09
  20. www.vals.ai/benchmarks/legal_research · 2026-10-05, Legal Research Bench and its evaluation partners
  21. www.vals.ai/benchmarks/web_search · 2026-10-05, Web Search Index leaderboard (updated 2026-07-16)
  22. www.vals.ai/benchmarks/cyber · 2026-10-05, CyberBench v1.1
  23. www.vals.ai/blogs/web-search-index · 2026-10-05, Web Search Index post and search partners
  24. www.vals.ai/blogs/vals-public-sector-memo · 2026-10-05, Public Sector launch, Glenn Parham, DC office; author photos (alt text confirms identity)
  25. www.vals.ai/blogs/child-ai-safety · 2026-10-05, Child AI Safety initiative
  26. www.vals.ai/blogs/evaluating-ai-safety-in-teen-conversations · 2026-10-05, Teen safety study with Stanford
  27. www.vals.ai/blogs/cheating-on-the-rise · 2026-10-05, Benchmark cheating audit
  28. www.vals.ai/blogs/ai-detection-benchmark · 2026-10-05, AI detector benchmark
  29. www.vals.ai/blogs/vals-environmental-impacts-report · 2026-10-05, Environmental impacts report
  30. www.vals.ai/blogs/thomson-n7-lean-proof · 2026-10-05, Lean proof of the Thomson problem for N=7
  31. www.vals.ai/blogs/faster-shortest-path-algorithm · 2026-10-05, C-HD shortest-path post
  32. www.vals.ai/blogs/fable-solves-cyphral-distich · 2026-10-05, Cyphral Distich post
  33. www.vals.ai/vals-smith · 2026-10-05, Vals Smith product page
  34. www.vals.ai/gov · 2026-10-05, Government offering; Public Benefits Bench
  35. www.vals.ai/vulnerability-disclosure-program · 2026-10-05, VDP effective 2026-08-31; no certifications
  36. www.vals.ai/product · 2026-10-05, Now the leaderboard hub; no SOC 2, GDPR or platform.vals.ai mentions
  37. github.com/vals-ai · 2026-10-05, GitHub org repos; licenses and creation dates through the GitHub API
  38. github.com/vals-ai/Valkyrie · 2026-10-05, Valkyrie: AGPL-3.0; Vals-hosted or self-hosted on AWS; CLI/SDK
  39. letsdatascience.com/news/vals-ai-launches-excel-modeling-benchmark-for-f · 2026-10-05, EMB launch coverage (reported)
  40. qa-financial.com/industry-on-a-mission-the-long-road-to-uniform-ai-testi · 2026-10-05, Langston Nashold as CTO and founder; co-founders Rayan Krishnan and Rez Havaei (Aug 2024)
  41. www.techtimes.com/articles/303524/20240412/standardized-ai-performance-t · 2026-10-05, Krishnan and Nashold left Stanford's AI master's program; Rez Havaei founding engineer
  42. arxiv.org/abs/2508.00828 · 2026-10-05, Finance Agent Benchmark paper (Bigeard, Nashold, Krishnan, Wu)
  43. www.vals.ai/authors/rayan.png · 2026-10-05, Rayan Krishnan headshot (200 image/png; alt 'Rayan Krishnan'; checked visually)
  44. www.vals.ai/authors/glenn.png · 2026-10-05, Glenn Parham headshot (200 image/png; alt 'Glenn Parham'; checked visually)
  45. www.linkedin.com/company/vals-ai · 2026-06-07, Public snippet: 11-50 employees (~19 profiles), San Francisco, Software Development
  46. www.crunchbase.com/organization/vals-ai · 2026-06-07, Funding profile (403 on direct fetch; details via search snippet): $5M seed, July 2024
  47. getlatka.com/companies/vals.ai/funding · 2026-06-07, Reported $1.3M revenue, 12-person team in 2025 (self-reported/estimated, unverified)
  48. www.bloomberg.com/news/newsletters/2024-04-11/this-startup-is-trying-to- · 2026-06-07, Bloomberg coverage of company (paywalled; headline only)
  49. www.deeplearning.ai/the-batch/vals-ai-evaluates-large-language-models-on · 2026-06-07, Third-party coverage of legal/finance/tax benchmarks
  50. www.lawnext.com/2025/05/vals-ai-issues-open-call-for-vendors-to-particip · 2026-06-07, Law firm consortium partners (Reed Smith, Fisher Phillips, McDermott Will & Emery, Ogletree Deakins); VLAIR vendors Harvey, CoCounsel; project lead Tara Waters; Legaltech Hub partnership
  51. finance.yahoo.com/news/vals-legal-ai-report-establishes-160000601.html · 2026-06-07, Alexi as legal AI vendor in VLAIR
  52. huggingface.co/datasets/vals-ai/finance_agent_benchmark · 2026-06-07, Finance Agent benchmark dataset
  53. github.com/vals-ai/finance-agent · 2026-06-07, Benchmark repo: MIT license, 141 stars, Python
  54. www.legaltechnologyhub.com/vendors/vals-ai/ · 2026-06-07, Legaltech Hub vendor listing / VLAIR partnership
Last updated 2026-10-05 · Every quantitative field carries a source and a confidence tag. Fields we could not source publicly are marked unknown, never estimated. See the methodology.