Anyscale
Software Engineer (Ray Core)
About this role
Anyscale seeks a Software Engineer to contribute to Ray Core, the C++ backend powering Ray's distributed computing framework. You'll work on performance optimization, fault tolerance, and architectural improvements for a system used by major companies like OpenAI and Spotify.
What you'll do
- Develop and maintain Ray's C++ backend including distributed scheduler and runtime integration
- Lead cross-team projects while mentoring junior engineers
- Optimize performance of large-scale distributed workloads
- Improve fault tolerance and high-availability features
- Enhance testing infrastructure and release processes
- Communicate technical work through talks, tutorials, and blog posts
What they're looking for
- C/C++ programming
- Distributed systems design and implementation
- Low-level operating systems knowledge
- Algorithms and data structures
- System design and architecture
- Fault tolerance and reliability patterns
- GPU programming (preferred)
- Distributed model training/inference (preferred)
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Anyscale
Anyscale builds Ray, an open-source distributed computing framework and enterprise platform for scaling AI workloads across Kubernetes and cloud providers. The company is hiring forward-deployed engineers to work embedded with customers, software engineers to develop Ray Core, LLM inference specialists, and customer support engineers who combine technical expertise with post-sale success.
- Website
- anyscale.com
Likely interview questions
- Describe your experience building scalable and fault-tolerant distributed systems—what were the key challenges?
- Walk us through a complex performance optimization you've done in C/C++; how did you identify and measure the bottleneck?