Vannevar
Backend Engineer, Collection Platform
About this role
Vannevar seeks a Backend Engineer to build and operate production web scrapers, data pipelines, and third-party integrations that reliably acquire mission-critical data for defense and national security applications. You'll design systems that handle upstream failures, schema changes, and data quality challenges while partnering with mission teams and product managers.
What you'll do
- Build and operate production web scrapers, integrations, and data pipelines handling unreliable upstream systems
- Design resilient systems with retry, backfill, deduplication, idempotency, and replay mechanisms
- Define and monitor data completeness, correctness, freshness, duplication, and provenance metrics
- Develop APIs, databases, and shared services supporting collection workflows
- Partner with mission, platform, and product teams to evaluate sources and support new data requirements
- Influence architecture, technology selection, and engineering standards for collection systems
What they're looking for
- Python backend development with production experience
- Web scraping and data ingestion systems
- Relational database design and SQL
- REST API design and third-party integrations
- ETL pipeline development and data quality management
- Systems design for failure tolerance and external interface changes
- Distributed task processing and workflow orchestration (nice to have)
- Data quality monitoring and production debugging
Benefits
- Health, dental, and vision insurance
- Unlimited PTO with federal holiday calendar and annual company downtime
- 401(k) matching
- Remote-friendly with WeWork access
- Lifestyle and wellness stipends plus fully paid parental leave
- Child and pet care reimbursement during travel, military reserve duty salary top-up
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Vannevar
Vannevar builds defense technology platforms that leverage data collection, agentic AI, and machine learning to support national security and military operations. The company is hiring Backend Engineers, Product Engineers, Machine Learning Engineers, and Forward Deployed Engineers to develop and modernize mission-critical software systems that enable faster, data-driven decision-making for warfighters.
- Website
- vannevar.ai
Likely interview questions
- Describe a complex web scraping or data ingestion system you built—how did you handle schema changes, rate limiting, and partial failures?
- How do you design idempotency and replay mechanisms into data pipelines, and why are they critical for mission-critical applications?