Clarity Innovations
Data Engineer
Herndon, VA and/or Columbia, MDmidAdded 2 days ago
About this role
Clarity Innovations seeks a Data Engineer to build and optimize ETL pipelines for a mission-critical data platform supporting the Intelligence Community and DoD. You'll design scalable data transport systems handling both batch and streaming workflows on Kubernetes, ensuring reliable cross-domain data operations in a national security environment.
What you'll do
- Develop ETL pipelines for bulk and streaming data ingestion into data lakes
- Optimize throughput, latency, and reliability of data transfer mechanisms
- Support secure low-to-high and high-to-low data transport workflows
- Implement monitoring, logging, and alerting for transport services
- Troubleshoot performance bottlenecks and transport failures
- Collaborate with platform and security teams on compliance and integration
What they're looking for
- ETL/ELT pipeline design and development
- Data transport and messaging systems
- Distributed systems and networked services
- Secure data transfer protocols and patterns
- Data integrity and pipeline validation
- Kubernetes deployment experience
- Streaming platforms (Kafka, RabbitMQ preferred)
- Operations in regulated/secure environments
Opens the official application on the employer’s site. No login required.