Forward Deployed Data Engineer (TS/SCI)

About this role

TRM Labs is seeking a Forward Deployed Data Engineer to partner with government clients, designing and implementing secure, scalable data lakehouse solutions on AWS. The role demands expertise in cloud architectures, data pipelines, and collaboration with technical teams to enhance mission success in the public sector.

What you'll do

• Design and deploy data lakehouse solutions on AWS.
• Develop production-ready ETL/ELT pipelines using Python and Spark.
• Containerize services on Kubernetes and manage infrastructure with Terraform.
• Create integrations for real-time analytics using various data sources.
• Engage in all phases of the software development lifecycle.
• Implement observability solutions to monitor and improve system performance.

What they're looking for

• Proficiency in Python, Apache Airflow, and Apache Spark.
• Deep SQL knowledge for query optimization.
• Experience with AWS services like S3, EMR, and EKS.
• Familiarity with secure cloud environments.
• Kubernetes deployment experience.
• Infrastructure-as-Code using Terraform or CloudFormation.
• CI/CD practices with tools like Jenkins or GitLab CI.
• Strong communication skills for interacting with diverse stakeholders.