ETL Senior Developer – AWS

Akaasa Technologies; Illinois; Presencial; USD 120.000 - 180.000; Jornada completa

Descripción de la vacante

Akaasa Technologies in Chicago, IL seeks a Senior ETL Developer IV to lead design, implementation, and optimization of massive-scale enterprise backend ETL and data analytics services within an AWS cloud ecosystem.

You will build robust, highly automated data pipelines that extract, transform, and load data from disparate systems to support enterprise reporting and analytics initiatives, collaborating with cross-functional teams and ensuring production stability.

Formación

• 6+ years of experience using ETL tools to perform data cleansing, data profiling, transforming, and scheduling diverse workflows.
• 6+ years of expert-level proficiency writing, debugging, and optimizing complex SQL queries.
• 3-4 years of programming experience writing complex code using Python or PySpark/Glue for large-scale data sets.
• 3-4 years of hands-on experience using core AWS services: AWS Glue, S3, Redshift, Lambda, Step Functions, RDS Aurora/MySQL, CloudWatch, SNS, SQS, and EventBridge.
• 3+ years of experience in Big Data processing, applying common design patterns, data models, and scalable architectures.
• Demonstrated capability troubleshooting database internals and common issues (e.g., AWS RDS MySQL).
• Hands-on experience with CI/CD and Infrastructure as Code (IaC), specifically Harness and developing/maintaining YAML and CloudFormation scripts.
• Relevant Airline industry experience

Responsabilidades

• Lead, design, implement, deploy, and optimize backend ETL services and data processing procedures.
• Support a massive-scale enterprise data solution using AWS data and analytics services.
• Analyze and interpret complex data and related systems, providing efficient technical solutions.
• Provide support to ETL schedules and maintain strict compliance with schedule execution.
• Develop and maintain standards for ETL code and maintain an effective project lifecycle across all ETL processes.
• Coordinate with cross-functional teams including architects, platform engineers, other developers, and product owners to build data processing workflows.
• Perform root cause analysis on production issues, conduct routine database monitoring, and provide operational support to ETL environments.
• Help create functional specifications and technical designs while partnering with business process area owners.
• Implement industry best practice code and configurations for production and non-production environments in a highly automated environment.
• Provide technical advice, effort estimates, and architectural impact analyses.
• Provide timely project status and incident/issue reporting to management.
• Support and troubleshoot critical production pipeline issues during odd hours in the event of major incidents.

Conocimientos

ETL Tools

SQL

Python/PySpark

AWS Services

Big Data

CI/CD

IaC

Herramientas

AWS Glue

S3

Redshift

Lambda

Step Functions

RDS Aurora/MySQL

CloudWatch

SNS

SQS

EventBridge

Harness

CloudFormation

Apache Iceberg

Dynatrace

DataDog

Descripción del empleo

Senior ETL Developer

2-3 days on site, Chicago,IL

JD: POSITION OVERVIEW The technology team is seeking a Senior ETL Developer IV to lead the design, implementation, and optimization of massive-scale enterprise backend ETL and data analytics services within an AWS cloud ecosystem. The mission is to build robust, highly automated data pipelines that extract, transform, and load data from disparate systems to support enterprise reporting and analytics initiatives.

DAY-TO-DAY RESPONSIBILITIES

• Lead, design, implement, deploy, and optimize backend ETL services and data processing procedures.
• Support a massive-scale enterprise data solution using AWS data and analytics services.
• Analyze and interpret complex data and related systems, providing efficient technical solutions.
• Provide support to ETL schedules and maintain strict compliance with schedule execution.
• Develop and maintain standards for ETL code and maintain an effective project lifecycle across all ETL processes.
• Coordinate with cross-functional teams including architects, platform engineers, other developers, and product owners to build data processing workflows.
• Perform root cause analysis on production issues, conduct routine database monitoring, and provide operational support to ETL environments.
• Help create functional specifications and technical designs while partnering with business process area owners.
• Implement industry best practice code and configurations for production and non-production environments in a highly automated environment.
• Provide technical advice, effort estimates, and architectural impact analyses.
• Provide timely project status and incident/issue reporting to management.
• Support and troubleshoot critical production pipeline issues during odd hours in the event of major incidents.

REQUIRED SKILLS

• 6+ years of experience using ETL tools to perform data cleansing, data profiling, transforming, and scheduling diverse workflows.
• 6+ years of expert-level proficiency writing, debugging, and optimizing complex SQL queries.
• 3 4 years of programming experience writing complex code using Python or PySpark/Glue for large-scale data sets.
• 3 4 years of hands-on experience using core AWS services: AWS Glue, S3, Redshift, Lambda, Step Functions, RDS Aurora/MySQL, CloudWatch, SNS, SQS, and EventBridge.
• 3+ years of experience in Big Data processing, applying common design patterns, data models, and scalable architectures.
• Demonstrated capability troubleshooting database internals and common issues (e.g., AWS RDS MySQL).
• Hands-on experience with CI/CD and Infrastructure as Code (IaC), specifically Harness and developing/maintaining YAML and CloudFormation scripts.
• Relevant Airline industry experience

ADDITIONAL DESIRED SKILLS

• Prior experience serving as a technical lead for a decent-sized ETL/data engineering team.
• Hands-on experience with Apache Iceberg table format for large analytic datasets.
• Familiarity with enterprise observability and application performance monitoring tools such as Dynatrace or DataDog.