SambaNova Systems
Cloud Platform Engineer
About this role
SambaNova is seeking a Cloud Platform Engineer to own the reliability, performance, and scalability of its AI Inferencing Service. You'll manage production infrastructure across multiple cloud providers and regions, participate in on-call rotations, and drive automation to prevent incidents before they occur.
What you'll do
- Own production inferencing service availability, latency, performance, and efficiency across multiple regions
- Participate in balanced on-call rotation to provide 24/7 support and lead incident response
- Develop monitoring, alerting, and dashboarding using Prometheus, Grafana, or Datadog to track service health and model performance
- Manage cloud infrastructure on AWS, GCP, and Azure using Infrastructure as Code tools like Terraform and Ansible
- Design and implement auto-scaling policies and capacity planning to optimize costs and handle variable inference loads
- Build CI/CD pipelines for safe deployment of model versions and automate manual operational tasks
What they're looking for
- Cloud infrastructure (AWS, GCP, Azure)
- Infrastructure as Code (Terraform, Ansible)
- Monitoring and observability (Prometheus, Grafana, Datadog)
- CI/CD and deployment automation
- Incident management and post-mortem practices
- Performance optimization and capacity planning
- Linux and containerization (Docker, Kubernetes)
- Python or similar scripting languages
Benefits
- Balanced on-call rotation with follow-the-sun coverage model
- Focus on prevention and automation to reduce operational toil
- Opportunity to work on cutting-edge AI infrastructure
- Multi-region infrastructure management experience
- Blameless incident culture with emphasis on learning
- Role in shaping SLOs and reliability standards
Opens the official application on the employer’s site. No login required.
SambaNova Systems
SambaNova Systems builds AI inference and machine learning platforms with specialized compiler infrastructure and runtime optimization. The company is hiring for compiler engineers, software engineers, runtime engineers, and ML solutions engineers to enhance its AI platform capabilities, as well as process and quality engineers for manufacturing excellence.
- Website
- sambanova.ai
Likely interview questions
- Describe your experience designing and maintaining monitoring systems for high-availability services; how do you prevent alert fatigue?
- Tell us about a time you identified a performance bottleneck in production and drove a solution from investigation to deployment.