Senior Data Engineer: Spark, Scala & Gen AI on AWS

resonate; United States; On-site; USD 150,000 - 210,000; Full time

Job summary

Resonate is transforming how brands understand customer behavior through large-scale data pipelines. You will design, build, and maintain ETL/ELT workflows using Spark and Scala on AWS, handling terabyte-scale datasets across S3 and Snowflake.

The role emphasizes Gen AI-enabled development and production-grade reliability. You will collaborate with senior engineers and product management to move requests from design to production, monitor health with Grafana, and ensure data quality with

Qualifications

• Five or more years in software/data engineering.
• Hands-on Spark and Scala with DataFrame/Dataset APIs.
• Experience tuning Spark at multi-terabyte or larger scale.
• Strong debugging and production fault handling.

Responsibilities

• Design, build, and maintain ETL/ELT pipelines on Spark/Scala (AWS EMR, S3, Snowflake).
• Tune Spark applications for performance and cost at large scale.
• Collaborate with senior engineers and product management from design to production.
• Monitor pipeline health in Grafana and fix data quality issues.
• Write clean, testable code with unit/integration tests; leverage Gen AI for speed.
• Use Gen AI tools across pipeline development, monitoring, and daily work.
• Take part in code reviews, technical design discussions, and sprint planning.
• Support production operations including on-call rotation and incident response.

Skills

Spark

Scala

AWS

Data engineering

Gen AI

Education

Bachelor's degree in CS/CE or equivalent

Tools

AWS EMR

S3

Snowflake

Grafana

Docker

Kafka

Hadoop

Job description

Resonate is transforming how brands understand customer behavior through large-scale data pipelines. You will design, build, and maintain ETL/ELT workflows using Spark and Scala on AWS, handling terabyte-scale datasets across S3 and Snowflake.

The role emphasizes Gen AI-enabled development and production-grade reliability. You will collaborate with senior engineers and product management to move requests from design to production, monitor health with Grafana, and ensure data quality with