Reducto
Machine Learning Eval Engineer
San Francisco Office$150k–$300kfulltimemidAdded 2 days ago
About this role
Reducto is seeking an ML Eval Engineer to enhance their document processing models by developing evaluation benchmarks and metrics. This role involves leveraging collaborative efforts with various teams to identify model weaknesses and drive improvements in model quality through insightful analysis of unstructured data.
What you'll do
- Design and maintain evaluation benchmarks for model performance.
- Develop metrics to identify failure modes in real-world datasets.
- Collaborate with ML engineers to translate evaluation insights into improvements.
- Work with unstructured enterprise data to pinpoint edge cases.
- Create internal tools to analyze model behavior and evaluation results.
- Engage with clients to tailor benchmarks that reflect their data needs.
What they're looking for
- Strong Python programming skills
- Experience with data infrastructure (AWS S3)
- Ability to work with unstructured data
- Experience in fast-paced, high-growth environments
- Effective collaboration skills
- Problem-solving capabilities
- Technical solution development
- Understanding of analytics systems
Benefits
- Opportunity for high-impact work
- Dynamic and fast-changing work environment
- Involvement in early-stage company growth
- Collaboration with top industry partners
- Potential for professional development
- [Unknown]
Opens the official application on the employer’s site. No login required.