Epoch AI
Software Engineer, Benchmarking
Remote (Remote)full timemidAdded 1 month ago
About this role
Epoch AI seeks a Software Engineer to develop and maintain benchmarking infrastructure for evaluating frontier AI models. You'll work with a team to run existing benchmarks, integrate with AI providers, create new benchmarks, and support internal research experiments.
What you'll do
- Run and maintain AI benchmarking infrastructure
- Integrate with AI model providers and services
- Set up and deploy existing benchmarks on internal systems
- Design and develop new benchmarks for AI evaluation
- Support and facilitate internal experiments
- Collaborate with the benchmarking team on infrastructure improvements
What they're looking for
- Software engineering and systems design
- Infrastructure development and maintenance
- API integration
- Python or similar programming languages
- Cloud platforms and deployment tools
- Database management
- Testing and debugging
- Version control systems
Benefits
- Fully remote position
- International hiring across many countries
- Rolling applications (flexible timeline)
- Collaborative research environment
- Work on frontier AI evaluation challenges
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Epoch AI
Epoch AI builds benchmarking infrastructure for evaluating frontier AI models, helping assess and compare advanced AI systems. The company is hiring Software Engineers to develop and maintain this infrastructure, run benchmarks, integrate with AI providers, and support research experiments.
View all jobs at Epoch AILikely interview questions
- Can you describe your experience with setting up and maintaining infrastructure for running automated benchmarks or tests at scale?
- How have you integrated with external APIs or services (like AI model providers) in previous projects?