Senior Data Engineer: Cloud Pipelines, MWAA & Gen AI

EPAM Systems Inc; México; Remote; MXN 800,000 - 1,200,000; Full time

Benefits offered by this job

Healthcare benefits

Paid time off

Job summary

EPAM Systems Inc. is seeking a hands-on Senior Data Engineer to design, build, and support scalable data pipelines and cloud-based data solutions on AWS. You will orchestrate workflows with MWAA, optimize queries in Athena, and automate infrastructure with Terraform and GitHub Actions.

You will work in an Agile environment, collaborating with engineering, product, and business teams to ensure production-quality delivery and robust data quality controls.

Qualifications

• Minimum 3 years of relevant professional experience.
• Strong core Python programming skills for building data engineering solutions.
• Hands-on experience with Python Pandas for data manipulation and analysis.
• Proficiency in PySpark for processing large-scale distributed data.
• Experience with AWS MWAA or Apache Airflow for orchestrating data workflows.
• Working knowledge of AWS Athena for querying data stored in AWS.
• Experience using Terraform to automate infrastructure provisioning.
• Familiarity with GitHub Actions for CI/CD workflows.
• Solid understanding of DevOps practices applied to data engineering environments.
• Upper-intermediate English language skills (B1).

Responsibilities

• Design, build, and maintain scalable data pipelines deployed on AWS.
• Build and manage workflows through AWS Managed Workflows for Apache Airflow (MWAA).
• Develop and optimize data queries using AWS Athena.
• Automate infrastructure provisioning and deployment processes using Terraform and GitHub Actions.
• Implement testing, monitoring, troubleshooting, and data-quality controls.
• Participate in code reviews and promote engineering best practices.
• Collaborate with engineering, product, and business teams in an Agile environment.

Skills

Python

Pandas

PySpark

AWS

Airflow

DevOps

Data pipelines

CI/CD

Agile

English (B1+)

Tools

MWAA

Terraform

GitHub Actions

Athena

Job description

EPAM Systems Inc. is seeking a hands-on Senior Data Engineer to design, build, and support scalable data pipelines and cloud-based data solutions on AWS. You will orchestrate workflows with MWAA, optimize queries in Athena, and automate infrastructure with Terraform and GitHub Actions.

You will work in an Agile environment, collaborating with engineering, product, and business teams to ensure production-quality delivery and robust data quality controls.