Anthropic
Data Scientist, Developer Productivity
San Francisco, CA | New York City, NYFrom $460kmidAdded today
About this role
Anthropic seeks a Data Scientist to establish how developer productivity is measured and improved in an AI-first organization. You'll partner with engineering leadership to define metrics, run experiments on tooling changes, and build the analytical foundation that drives infrastructure investment decisions in a rapidly evolving space.
What you'll do
- Lead investigations into ambiguous questions like how AI tools impact engineer velocity and what 'productivity' means in this context
- Define and implement a metrics framework for developer productivity in AI-augmented workflows
- Design and execute experiments on internal tooling and workflow changes to establish causal evidence
- Build analytical pipelines, dashboards, and models to instrument productivity measurement
- Partner with engineering leadership to set the measurement agenda and research priorities
- Influence leadership decisions with data, openly challenging narratives when evidence doesn't support them
What they're looking for
- Production SQL and Python (or equivalent language)
- Data pipeline and dashboard development
- Experimental design and causal inference
- Metric definition and framework design
- Data storytelling and stakeholder communication
- Statistical analysis and modeling
- Ability to work in ambiguity and iterate quickly
- Understanding of developer tools and workflows
Benefits
- Work at the intersection of data science, developer experience, and frontier AI
- Opportunity to define a new measurement discipline from the ground up
- Hands-on technical role with direct impact on engineering infrastructure
- Located in San Francisco, CA or New York City, NY
Likely interview questions
- Tell us about a time you had to define a metric or measurement framework when the problem wasn't well-understood—how did you approach it?
- Describe a project where you designed an experiment to measure impact. How did you establish causality?
Opens the official application on the employer’s site. No login required.