Datasets
Real-world engineering tasks with reliable ground truth, written from scratch. Never scraped.
>SFT>Evals
[ Human-authored training data ]
Datasets, reasoning traces, RL environments and evals — written from scratch by senior engineers, calibrated to your model’s pass rate.
>NDA · lab-calibrated · never resoldEvery task is calibrated for an optimal 10–30% first-pass success rate on your target models, set where public benchmarks stop being useful. Too easy teaches nothing. Unsolvable teaches noise.
Live histogram of authored tasks by frontier-model pass rate. Tasks between 10% and 30% pass@1 are accepted; above 80% they are rejected as too easy; at 0% as not solvable; everything else goes back to its author. 142 of 388 tasks accepted in this batch.
Every datapoint is created from scratch by senior practitioners: primarily senior software engineers, alongside vetted domain specialists. Never scraped, never synthetic.
Real-world engineering tasks with reliable ground truth, written from scratch. Never scraped.
>SFT>Evals
Step-by-step solutions from senior engineers, dead ends included, so a model learns how the answer was found.
>SFT>Process rewards
Executable tasks with verifiable rewards and rubrics, tuned to your agent’s pass rate.
>RL>Verifiable rewards
Private, expert-graded benchmarks for the places where public ones saturate.
>Evals>Rubrics
A redacted task, the expert’s reasoning, and the QA it passed. Redacted, because yours will be too.
Make Pool::shutdown() in the service wait for every borrowed connection, without holding the lock across an .await.
Typically 10–50 tasks to align on research goals, target difficulty and format, and to validate clarity, correctness and model pass rates before scaling.
10–50 tasks
schema · targets · QA bars
senior engineers · NDA
pass@1 → 0.10–0.30
JSONL · Parquet · envs
Calibrated on your target models, where public benchmarks stop being useful.
Automated validation, dual independent reviews, final acceptance testing.
Written from scratch. Never scraped, never synthetic, never resold.
Tell us the data type; we send a free sample under NDA.
Scraped text runs out at the frontier, and synthetic data teaches a model its own mistakes. So every task we ship is written from scratch by a senior engineer, reviewed twice, solved independently by a domain expert, and calibrated against your model before it leaves our hands.