ThinkingMachines
Software Engineer, Evaluation Platform / Infra
- Confirmed live in the last 24 hours
- $300k–$350k
- Mid level
- Full-time
- On-site · San Francisco
- 2+ yrs exp
- Added 1 month ago
About this role
Thinking Machines is seeking a Software Engineer to build and maintain a critical evaluation platform for their frontier AI models. This role involves designing and developing end-to-end solutions, collaborating with research teams, and ensuring the platform supports reproducible and trustworthy evaluation results. You'll utilize your strong software engineering skills across Python, Rust, React, and Typescript to create scalable and user-friendly tools.
What you'll do
- Design, build, and maintain the evaluation platform.
- Develop flexible abstractions for various evaluation components.
- Ensure reproducible and trustworthy results through versioning and quality controls.
- Partner with researchers to improve evaluation workflows.
- Work across the entire technical stack from backend to frontend.
What they're looking for
- Python
- Rust
- React
- Typescript
- Data Pipelines
- Distributed Systems
- Databases
- Software Engineering Fundamentals
Benefits
- Health, Dental, and Vision benefits
- Unlimited PTO
- Paid Parental Leave
- Relocation Support
- Visa Sponsorship
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
ThinkingMachines
Likely interview questions
- Describe your experience building or maintaining evaluation systems for LLMs or multimodal models.
- Walk me through a time you collaborated with researchers to translate their needs into a technical solution.