xAI
Backend Engineer - API
Palo Alto, CA$180k–$440kmidAdded 2 days ago
About this role
xAI is seeking a Backend Engineer skilled in API development with experience in building scalable and reliable systems. The role involves creating the xAI API, managing high-throughput inference systems, and requires proficiency in Rust or C++.
What you'll do
- Develop the xAI API for global model access
- Manage high-throughput inference systems
- Oversee model serving infrastructure and request routing
- Implement rate limiting and observability features
- Ensure efficient scaling of systems
What they're looking for
- Expert knowledge of Rust or C++
- Experience with distributed systems design
- Knowledge of service observability best practices
- Database management (PostgreSQL, Clickhouse, MongoDB)
- Familiarity with LLM inference engines
- Experience with Docker and Kubernetes
- Understanding of gRPC protocols
Benefits
- Salary range: $180,000 - $440,000
- Equity options
- Comprehensive medical, vision, and dental coverage
- 401(k) retirement plan access
- Disability and life insurance
- Additional discounts and perks
Opens the official application on the employer’s site. No login required.