Anyscale
Software Engineer, ML Developer Experience
About this role
Join Anyscale's ML Developer Experience team to build the user-facing layer of a distributed computing platform powered by Ray. You'll own end-to-end developer tooling, APIs, CLIs, and observability systems that help developers and AI agents scale machine learning workloads from laptop to production.
What you'll do
- Design and build developer tooling, CLIs, SDKs, and APIs for discovering, configuring, and running AI workloads on Ray
- Develop observability and debugging solutions that surface failures across jobs, tasks, actors, nodes, and GPUs
- Work across the full AI workload lifecycle including data preparation, fine-tuning, serving, evaluation, and model deployment
- Build backend services and control-plane infrastructure powering Anyscale's platform across serverless and bring-your-own-cloud environments
- Collaborate with users and field teams to identify high-leverage problems and shape product and technical designs
- Create agent-first interfaces with structured errors, dry-run support, and consistent behavior across platform resources
What they're looking for
- Full-stack software engineering across developer tooling, cloud infrastructure, and distributed systems
- Experience building APIs, CLIs, and SDKs for developer platforms
- Understanding of machine learning workflows and MLOps practices
- Distributed systems and cloud infrastructure knowledge
- Python and systems programming languages
- Experience designing observability and monitoring systems
- Product judgment and ability to understand user needs
- Experience with Ray or similar distributed computing frameworks
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Anyscale
Anyscale builds Ray, an open-source distributed computing framework and enterprise platform for scaling AI workloads across Kubernetes and cloud providers. The company is hiring forward-deployed engineers to work embedded with customers, software engineers to develop Ray Core, LLM inference specialists, and customer support engineers who combine technical expertise with post-sale success.
- Website
- anyscale.com
Likely interview questions
- Tell us about a time you built developer tooling or APIs that served both novice and expert users—how did you balance simplicity with depth?
- Describe your experience diagnosing and surfacing failures in distributed systems. What made your solution effective for developers?