Data Engineer

About this role

Clarity Innovations seeks a Data Engineer to support Air Force Special Operations Command at Hurlburt Field, FL. You'll design and maintain data pipelines, optimize databases, and manage ETL infrastructure for complex national security data integration. The role requires strong programming skills, SQL/NoSQL expertise, and a Secret Clearance.

What you'll do

• Develop and maintain data infrastructure for ETL processes across structured and unstructured sources
• Design and optimize data pipelines using NoSQL, SQL, Spark, Hadoop, Kafka, and related frameworks
• Build APIs and complex queries to ensure data accessibility while optimizing performance
• Administer cloud platforms (Azure, AWS, Google Cloud) and CI/CD pipelines
• Apply distributed systems principles including fault-tolerance, consensus, and reliability
• Collaborate with product, data, and design teams to address data infrastructure needs

What they're looking for

• SQL and NoSQL database design (MongoDB, Cassandra, Neo4j)
• ETL pipeline development and optimization
• Big data frameworks (Spark, Hadoop, Kafka, Hive, Pig)
• Cloud platforms (AWS, Azure, Google Cloud)
• Programming languages (multiple required)
• Distributed systems concepts and fault-tolerance
• API design and integration
• Git, UML, Agile development

Benefits

• Mission-focused work supporting national security
• Embedded role with direct impact on AFSOC operations
• Opportunity to work with cutting-edge data modernization technologies
• People-focused company culture emphasizing career growth
• Access to advanced CI/CD and DevSecOps practices

Likely interview questions

• Describe your experience designing and optimizing ETL pipelines for large-scale data ingestion from multiple sources.
• How have you applied distributed systems concepts like fault-tolerance and consensus algorithms in previous projects?