Software engineers for AI coding data and evaluation.
Engineers who work in real codebases, not puzzles. They write and review the tasks, tests and reference solutions that coding models are trained and measured on.
What these contributors do.
Realistic issues in real repositories, with the context, constraints and acceptance tests a model needs to be judged fairly.
Hidden tests that check behaviour rather than one implementation, and reference solutions that pass them cleanly.
Line-level review of model-written code for correctness, edge cases, security and maintainability.
Reproducing failures, finding root causes and writing up what a model got wrong and why.
Evaluated on the work itself.
A work sample in the engineer's main language: a real bug or feature in an unfamiliar repository, with tests. A reviewer from our team checks the fix, the tests and whether they verified their own work.
Who we are looking for.
Engineers with professional experience in Python, TypeScript, Go, Rust, C++ or Java who enjoy reading other people's code. Paid, remote project work. Joining is free, and we never charge contributors a fee.
Need Coding & Software Engineering experts?
Tell us what you need in a line or two. A person on our team reads every request and replies by email.
Other areas: RL Environments · Agent Evaluation · Technical Review