Protege
Forward Deployed Machine Learning Engineer
- Confirmed live in the last 24 hours
- No salary listed
- Mid level
- Full-time
- Remote
- 4+ yrs exp
- Added 2 months ago
About this role
Protege is seeking a Forward Deployed Machine Learning Engineer to build the technical foundation for their Benchmarks and Evaluations vertical. You'll collaborate directly with the GM and researchers to define evaluation standards, build infrastructure, and translate customer engagements into product opportunities. This is a unique opportunity to join an early-stage company focused on solving a critical bottleneck in AI – accessing the right training data.
What you'll do
- Define evaluation standards in collaboration with the GM and customers.
- Design and build benchmarks for AI models.
- Develop backend infrastructure including data pipelines and orchestration.
- Build sandboxed environments for agentic evaluations.
- Identify repeatable evaluation patterns and infrastructure gaps.
- Partner with the DataLab team on data and research questions.
What they're looking for
- Machine Learning
- Infrastructure
- Data Pipelines
- Evaluation
- Benchmarks
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Protege
Likely interview questions
- Describe your experience evaluating machine learning models, specifically focusing on challenges you encountered and how you overcame them.
- Walk me through a time you had to build backend infrastructure from scratch. What were the biggest design considerations?