Resonate
Data Engineer
United StatesmidAdded today
About this role
Resonate seeks a senior Data Engineer to design and maintain massive-scale ETL/ELT pipelines using Spark and Scala on AWS, processing terabytes of consumer intelligence data. You'll optimize production pipelines, debug complex distributed systems issues, and integrate generative AI into the engineering workflow while partnering with product and senior engineers.
What you'll do
- Design, develop, and maintain ETL/ELT pipelines using Spark and Scala on AWS EMR with multi-terabyte datasets in S3 and Snowflake
- Tune and optimize large-scale Spark applications for performance and cost, solving problems unique to petabyte-scale processing
- Monitor pipeline health using Grafana, identify data quality issues, and resolve root causes
- Collaborate with product and senior engineers to translate requirements into production-ready pipelines
- Write clean, testable code with comprehensive unit and integration tests, leveraging Gen AI for development acceleration
- Participate in on-call rotation, incident response, and production operations support
What they're looking for
- Spark (DataFrame and Dataset APIs)
- Scala
- AWS (EMR, S3, Lambda)
- Snowflake
- Kafka
- Relational databases
- Generative AI tools
- Grafana and system monitoring
Opens the application — the Jobs AI extension fills it for you. Set up autofill
Opens the official application on the employer’s site. No login required.
Resonate
Resonate builds microservices and data pipelines for consumer data processing. The company is hiring Full Stack Software Developers to create and enhance these backend services and support agile engineering teams.
View all jobs at ResonateLikely interview questions
- Walk us through a time you debugged a Spark job that only failed in production at scale—what was the issue and how did you solve it?
- Describe your experience tuning multi-terabyte Spark applications; what performance bottlenecks have you encountered and addressed?