What Does an RL Environment Cost?

There's no published price list for an RL environment, and there probably won't be one for a while. Every deal is a bespoke contract. But the shape of pricing is consistent enough to talk about, and if you're trying to size a budget before you talk to a vendor, the numbers below are roughly in the right neighborhood.

What you actually pay for

Most environment contracts blend three components: an engagement fee to build or customize the environment to your tasks, a per-rollout or per-trajectory cost for running the agent against it during training, and a seat or access fee for the underlying platform and tooling. Some vendors split these out; others bundle. The bundled ones are usually more expensive but easier to forecast.

The order-of-magnitude ranges

For a research-grade engagement — a small environment, a single domain, modest rollout volumes — you should expect five to low six figures a year. For production training against a polished, high-fidelity environment with custom graders and substantial rollout volumes, mid six to low seven figures is normal. The largest frontier-lab contracts run into the eight figures, and reporting has suggested a single lab considering more than a billion dollars across its full environment vendor stack in a year. That's the ceiling, not the median.

What drives the bill

Four things move the price more than anything else.

Grader complexity. A test-based grader for a coding environment is cheap. A grader that has to check backend state across a multi-step enterprise workflow is expensive. Expect the grader to be a meaningful share of the total.

Task volume. A static catalog of 500 tasks is one price. A live task-generation pipeline producing thousands of fresh variants per week is several multiples more.

Determinism and reset infrastructure. Cheap environments run against the live internet and accept the flakiness. Expensive environments ship dockerized, resettable, fully state-inspected clones. The second kind costs more for a reason.

Exclusivity. Some vendors will sell an environment non-exclusively and you share it with other labs. Some will sell it exclusively. Exclusivity is where the seven-figure deals come from.

Open source as a baseline

Open environments cost nothing to license and you can fix them yourself. They're a sensible benchmark to price commercial offers against: if a vendor wants seven figures for something that looks a lot like an open project plus a grader, it's worth asking what exactly the grader is doing for you.

Browse vendors

See every vendor in the category, scored on a public rubric, on the RL environment companies list.