Runtime Engineer

About this role

MatX is seeking a Runtime Engineer to develop and manage the host-side stack for their custom silicon designed for large-language models. The role involves building interface libraries, extending executable formats, and optimizing performance for ML systems.

What you'll do

• Develop the host-side interface library and device memory management
• Extend the executable format and manage compiler-runtime contracts
• Design custom-kernel ABI and host-side marshaling layer
• Create Python bindings and a LLM inference serving stack
• Implement interconnect topology and error recovery systems
• Define profiling and debugging surfaces for the chip

What they're looking for

• Proficient in Rust, C, C++, or Go
• Experience with Python interop layers (e.g., PyO3)
• API or ABI contract design and maintenance
• Familiarity with accelerator programming models
• Understanding of ML systems and tensor layouts
• Knowledge of custom allocator design and low-level memory management
• Experience with ML framework integration
• Profiler or tracing infrastructure familiarity

Benefits

• Flexible cash equity compensation
• Comprehensive health and wellness benefits
• Generous paid time off and remote work options
• Paid parental leave
• Professional development budget
• 401K with company contribution