Senior ETL Lead - AWS Data Pipelines & Analytics

Zuven technologies Inc; Chicago (IL); On-site; USD 120,000 - 180,000; Full time

Job summary

Zuven Technologies Inc in Chicago is seeking a Senior ETL Developer IV to lead the design, implementation, and optimization of large-scale backend ETL and data analytics services within an AWS cloud ecosystem, building highly automated data pipelines for enterprise reporting and analytics.

You will collaborate with architects, platform engineers, developers, and product owners to create data processing workflows, own ETL schedules, enforce coding standards, and provide operational support across

Qualifications

• 6+ years of experience using ETL tools to perform data cleansing, data profiling, transforming, and scheduling diverse workflows.
• 6+ years of expert-level proficiency writing, debugging, and optimizing complex SQL queries.
• 3–4 years of programming experience writing complex code using Python or PySpark/Glue for large-scale data sets.
• 3–4 years of hands-on experience using core AWS services: AWS Glue, S3, Redshift, Lambda, Step Functions, RDS Aurora/MySQL, CloudWatch, SNS, SQS, and EventBridge.
• 3+ years of experience in Big Data processing, applying common design patterns, data models, and scalable architectures.
• Demonstrated capability troubleshooting database internals and common issues (e.g., AWS RDS MySQL).
• Hands-on experience with CI/CD and Infrastructure as Code (IaC), specifically Harness and developing/maintaining YAML and CloudFormation scripts.

Responsibilities

• Lead, design, implement, deploy, and optimize backend ETL services and data processing procedures.
• Support a massive-scale enterprise data solution using AWS data and analytics services.
• Analyze and interpret complex data and related systems, providing efficient technical solutions.
• Provide support to ETL schedules and maintain strict compliance with schedule execution.
• Develop and maintain standards for ETL code and maintain an effective project lifecycle across all ETL processes.
• Coordinate with cross-functional teams including architects, platform engineers, other developers, and product owners to build data processing workflows.
• Perform root cause analysis on production issues, conduct routine database monitoring, and provide operational support to ETL environments.
• Help create functional specifications and technical designs while partnering with business process area owners.
• Implement industry best practice code and configurations for production and non-production environments in a highly automated environment.
• Provide technical advice, effort estimates, and architectural impact analyses.
• Provide timely project status and incident/issue reporting to management.
• Support and troubleshoot critical production pipeline issues during odd hours in the event of major incidents.

Skills

ETL pipelines

SQL

Python/PySpark

Big Data

CI/CD

IaC

Root cause analysis

Leadership/mentoring

Tools

AWS Glue

S3

Redshift

Lambda

Step Functions

RDS Aurora/MySQL

CloudWatch

SNS

SQS

EventBridge

Harness

YAML

CloudFormation

Job description

Zuven Technologies Inc in Chicago is seeking a Senior ETL Developer IV to lead the design, implementation, and optimization of large-scale backend ETL and data analytics services within an AWS cloud ecosystem, building highly automated data pipelines for enterprise reporting and analytics.

You will collaborate with architects, platform engineers, developers, and product owners to create data processing workflows, own ETL schedules, enforce coding standards, and provide operational support across