Senior AWS Data Engineer: ETL & Big Data Pipelines

Ethereum Technologies; Chicago (IL); On-site; USD 120,000 - 160,000; Full time

Job summary

Ethereum Technologies in Chicago, IL seeks a Senior ETL Developer to design, build, and optimize large-scale data pipelines within the AWS ecosystem, using Python, PySpark and SQL for enterprise analytics.

You will implement CI/CD with Harness and AWS CloudFormation, ensure data quality, troubleshoot production ETL, and collaborate with architects, developers, and stakeholders to deliver reliable data solutions.

Qualifications

• 6+ years of ETL development experience.
• 6+ years of SQL experience, including complex queries.
• 3–4 years hands-on Python/PySpark with large-scale datasets.
• 3–4 years AWS Cloud experience (Glue, S3, Redshift, Lambda, Step Functions, RDS Aurora/MySQL).
• 3+ years Big Data processing, data modeling, scalable architectures.
• Hands-on DevOps / CI/CD with Harness, YAML, and AWS CloudFormation.
• Strong database troubleshooting and production support skills.

Responsibilities

• Design, develop, implement, and optimize enterprise-scale ETL pipelines and backend data processing solutions.
• Build and maintain scalable data pipelines using AWS Glue, Python, PySpark, and SQL.
• Develop complex SQL queries, stored procedures, and data transformation workflows.
• Work with AWS services including S3, Redshift, Lambda, Step Functions, RDS, CloudWatch, SNS, SQS, and EventBridge.
• Perform data cleansing, profiling, transformation, and workflow scheduling.
• Troubleshoot ETL failures, database performance issues, and production incidents.
• Implement CI/CD pipelines and Infrastructure as Code using Harness, YAML, and AWS CloudFormation.
• Collaborate with architects, developers, and business stakeholders to deliver enterprise data solutions.
• Perform root cause analysis and provide production support for critical ETL processes.
• Maintain coding standards, technical documentation, and ETL development best practices.

Skills

ETL Development

SQL

Python/PySpark

AWS Cloud

Big Data

DevOps / CI/CD

Database Troubleshooting

Tools

AWS Glue

S3

Redshift

Lambda

Step Functions

RDS Aurora/MySQL

CloudWatch

SNS

SQS

EventBridge

Harness

AWS CloudFormation

Job description

Ethereum Technologies in Chicago, IL seeks a Senior ETL Developer to design, build, and optimize large-scale data pipelines within the AWS ecosystem, using Python, PySpark and SQL for enterprise analytics.

You will implement CI/CD with Harness and AWS CloudFormation, ensure data quality, troubleshoot production ETL, and collaborate with architects, developers, and stakeholders to deliver reliable data solutions.