Senior ETL Engineer - AWS Data Pipelines & Analytics

Akaasa Technologies; Illinois; Sur place; USD 120 000 - 180 000; Plein temps

Résumé du poste

Akaasa Technologies in Chicago, IL seeks a Senior ETL Developer IV to lead design, implementation, and optimization of massive-scale enterprise backend ETL and data analytics services within an AWS cloud ecosystem.

You will build robust, highly automated data pipelines that extract, transform, and load data from disparate systems to support enterprise reporting and analytics initiatives, collaborating with cross-functional teams and ensuring production stability.

Qualifications

• 6+ years of experience using ETL tools to perform data cleansing, data profiling, transforming, and scheduling diverse workflows.
• 6+ years of expert-level proficiency writing, debugging, and optimizing complex SQL queries.
• 3-4 years of programming experience writing complex code using Python or PySpark/Glue for large-scale data sets.
• 3-4 years of hands-on experience using core AWS services: AWS Glue, S3, Redshift, Lambda, Step Functions, RDS Aurora/MySQL, CloudWatch, SNS, SQS, and EventBridge.
• 3+ years of experience in Big Data processing, applying common design patterns, data models, and scalable architectures.
• Demonstrated capability troubleshooting database internals and common issues (e.g., AWS RDS MySQL).
• Hands-on experience with CI/CD and Infrastructure as Code (IaC), specifically Harness and developing/maintaining YAML and CloudFormation scripts.
• Relevant Airline industry experience

Responsabilités

• Lead, design, implement, deploy, and optimize backend ETL services and data processing procedures.
• Support a massive-scale enterprise data solution using AWS data and analytics services.
• Analyze and interpret complex data and related systems, providing efficient technical solutions.
• Provide support to ETL schedules and maintain strict compliance with schedule execution.
• Develop and maintain standards for ETL code and maintain an effective project lifecycle across all ETL processes.
• Coordinate with cross-functional teams including architects, platform engineers, other developers, and product owners to build data processing workflows.
• Perform root cause analysis on production issues, conduct routine database monitoring, and provide operational support to ETL environments.
• Help create functional specifications and technical designs while partnering with business process area owners.
• Implement industry best practice code and configurations for production and non-production environments in a highly automated environment.
• Provide technical advice, effort estimates, and architectural impact analyses.
• Provide timely project status and incident/issue reporting to management.
• Support and troubleshoot critical production pipeline issues during odd hours in the event of major incidents.

Connaissances

ETL Tools

SQL

Python/PySpark

AWS Services

Big Data

CI/CD

IaC

Outils

AWS Glue

S3

Redshift

Lambda

Step Functions

RDS Aurora/MySQL

CloudWatch

SNS

SQS

EventBridge

Harness

CloudFormation

Apache Iceberg

Dynatrace

DataDog

Description du poste

Akaasa Technologies in Chicago, IL seeks a Senior ETL Developer IV to lead design, implementation, and optimization of massive-scale enterprise backend ETL and data analytics services within an AWS cloud ecosystem.

You will build robust, highly automated data pipelines that extract, transform, and load data from disparate systems to support enterprise reporting and analytics initiatives, collaborating with cross-functional teams and ensuring production stability.