Baseten
Software Engineer - Observability
About this role
Baseten seeks a Software Engineer to join its early-stage Observability team, building scalable telemetry pipelines and diagnostic tools for multi-cloud AI infrastructure. You'll design high-throughput systems for metrics, logs, and traces while enabling reliable incident detection and resolution across rapidly growing systems.
What you'll do
- Design and build scalable telemetry ingest and storage pipelines for metrics, logs, and traces across multi-cloud infrastructure
- Own core observability platforms and drive architectural improvements for reliability, cost reduction, and organizational scaling
- Create instrumentation libraries, SDKs, and integrations for teams to emit high-quality telemetry
- Develop alerting and SLO infrastructure that minimizes noise while enabling reliable monitoring
- Partner with Inference, Product, and Infrastructure teams to tailor observability solutions to organizational needs
- Apply AI/LLMs to operational workflows such as root cause analysis and anomaly detection
What they're looking for
- Deep expertise in one observability signal area (metrics, logging, tracing, or error analytics)
- High-throughput data pipelines and columnar storage engines
- Proficiency in Python, Rust, or Go
- Experience with Prometheus, Grafana, ClickHouse, OpenTelemetry, or similar platforms
- Multi-cloud infrastructure knowledge
- Strong communication and cross-team collaboration
- Infrastructure and systems design
- AI/LLM application to operational workflows
Benefits
- Competitive compensation with meaningful equity
- 100% coverage of medical, dental, and vision insurance for employee and dependents
- Flexible PTO policy with company-wide Winter Break closure
- Paid parental leave and fertility/family-building stipend
- Company-facilitated 401(k)
- Exposure to diverse ML startups for learning and networking
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Baseten
Baseten builds an AI inference platform that enables companies to deploy and manage machine learning models in production at scale. The company is hiring software engineers, infrastructure specialists, and product engineers to develop observability systems, frontend experiences, reliability infrastructure, developer tools, and enterprise deployment solutions.
- Website
- baseten.com
Likely interview questions
- Walk us through a time you built or optimized a high-throughput data pipeline—what were the key tradeoffs you made?
- Describe your experience with observability platforms like Prometheus or ClickHouse. How did you apply them to solve a specific operational challenge?