Application Software Engineer, Inference

About this role

SpaceX is seeking an Application Software Engineer for its Inference team in Palo Alto. The role focuses on designing and optimizing AI inference systems that power mission-critical applications, ensuring high performance and reliability in a collaborative environment.

What you'll do

• Develop high-throughput, reliable inference systems for AI models
• Architect scalable distributed infrastructure for model serving
• Optimize latency and throughput of model inference under production workloads
• Build high-concurrency serving systems with 100% uptime
• Benchmark and accelerate inference engines
• Create robust CI/CD infrastructure for deployment and updates

What they're looking for

• Distributed systems design
• Full stack or backend development
• Experience with Rust or C++
• Model serving frameworks knowledge
• Low-level systems programming
• Observability practices
• Collaboration skills