Senior Data Engineer, AWS Data Lake & Serverless Infra

D8 LooP; Seattle (WA); On-site; USD 150,000 - 190,000; Full time

Job summary

D8 LooP is seeking a Senior Data Engineer to design, implement, and operate AWS-based data pipelines for its infrastructure and data lake. The role combines data modeling, warehousing, and streaming technologies to support scalable data warehousing and analytics.

You will work on a serverless architecture using Redshift Spectrum, Athena, S3, Lambda, Glue, EMR, Kinesis, and CloudWatch, ensuring data quality, governance, and security across the data platform.

Qualifications

• Experience with data modeling, warehousing and ETL pipelines.
• Proficiency in Python and/or Java/Scala/NodeJS.
• SQL expertise required.
• Experience with Spark and big data tech (Hadoop/Hive/Spark/EMR).
• Experience operating large data warehouses.
• Familiarity with AWS data services (S3/Glue/Lambda/SNS/SQS/KMS).
• Knowledge of data lake/warehouse governance and security.

Responsibilities

• Develop and maintain automated ETL pipelines with monitoring using Python, Spark, SQL and AWS services.
• Build and grow a serverless data lake/warehousing stack (Redshift Spectrum, Athena, S3, Lambda, Glue, EMR, Kinesis).
• Collaborate across teams to ensure data quality, performance and cost efficiency.

Skills

Data modeling

ETL pipelines

Python

SQL

Spark

Big data

Warehousing

Tools

S3

Glue

Lambda

SNS

SQS

KMS

Redshift Spectrum

Athena

EMR

Kinesis

CloudWatch

Job description

D8 LooP is seeking a Senior Data Engineer to design, implement, and operate AWS-based data pipelines for its infrastructure and data lake. The role combines data modeling, warehousing, and streaming technologies to support scalable data warehousing and analytics.

You will work on a serverless architecture using Redshift Spectrum, Athena, S3, Lambda, Glue, EMR, Kinesis, and CloudWatch, ensuring data quality, governance, and security across the data platform.