Staff Software Engineer - AI Data Platform

3w3 weeks ago

Labelbox

US · Full-time · $250,000 – $280,000

About this role

At Labelbox, we're building the critical infrastructure that powers breakthrough AI models at leading research labs and enterprises. As a Staff Software Engineer on the AI Data Platform, you'll join the team behind the RL data factory for advancing frontier agent capabilities.

You will build eval systems that run millions of agent trajectories to measure model and product quality, and fine-tuning pipelines that turn evaluation signals into measurable agent improvements. Your work will span agent-first product surfaces, including UX and infrastructure for workflows where the user is a model or an agent operator.

We operate like an early-stage startup, focusing on impact over process, and we celebrate those who take ownership, move fast, and deliver impact. You'll take on expanded responsibilities quickly, with career growth directly tied to your contributions, and be surrounded by curious minds solving complex problems at the frontier of AI.

Every role requires continuous learning and evolution, and you'll have clear ownership of your work with the autonomy to execute. You'll know exactly what you're responsible for and have the metrics to drive results, all while working at the cutting edge of AI development.

Requirements

4+ year track record of shipping systems customers and other engineers rely on
You build full stack prototypes fast and they hold up; the v1 you ship becomes the foundation the rest of the team builds on
Strong system and API design judgement
Hard architecture and product calls land with you; you make them, defend them under pressure, and update fast when someone else is right
You ship production code with coding agents daily and know where they break and what it takes to make them reliable
You set direction by being the example; other engineers reach for your designs and your code as the reference

Responsibilities

Build eval systems that run millions of agent trajectories to measure model and product quality
Develop fine-tuning pipelines that turn evaluation signals into measurable agent improvements
Design agent-first product surfaces: UX and infrastructure for workflows where the user is a model or an agent operator
Build the systems behind hundreds of thousands of AI interviews used to source and match freelance workers to projects
Create infrastructure that scales to the throughput frontier labs actually need
Integrate the latest models and capabilities into production within days of release