Software Engineer, RL Environments

About this role

Build reinforcement learning training environments at Cursor by transforming diverse data sources into realistic, high-quality tasks. You'll own platforms and data pipelines that enable teams to create, validate, and scale RL environments for training AI models across knowledge-work domains.

What you'll do

• Design and build platforms for creating complex, diverse RL environments at scale
• Build end-to-end data pipelines that convert raw data into training-ready environments
• Define and enforce quality standards across vendor, tutor, acquired, and synthetic data sources
• Create self-serve APIs and tooling for internal and external teams building tasks and environments
• Partner across research and platform teams to translate model capability goals into effective training tasks
• Own data validation and quality automation to ensure trustworthy training data

What they're looking for

• Software engineering fundamentals and architecture
• Data platforms and ETL pipeline design
• Distributed systems and scalability
• ML infrastructure and model training concepts
• Data validation and quality automation
• API design and developer tooling
• Working with heterogeneous and messy datasets
• Cross-disciplinary collaboration and communication