Senior Data Engineer — Scale Pipelines on AWS & Airflow

EPAM Systems Inc; Colombia; Remote; COP 120,000,000 - 180,000,000; Full time

Benefits offered by this job

Healthcare benefits

Employee financial programs

Paid time off

Job summary

EPAM Systems Inc. is seeking a hands-on Senior Data Engineer in Colombia to design, build, and support scalable data pipelines on AWS. You will leverage Python, Pandas, and PySpark to deliver robust data processing solutions and orchestrate workflows with MWAA.

Automate infrastructure with Terraform and GitHub Actions, and enforce data quality in an Agile setting. The role emphasizes production-grade engineering, DevOps practices, and collaboration with cross-functional teams on complex data

Qualifications

• 3+ years of data engineering experience.
• Strong Python and Pandas for data processing.
• Hands-on PySpark for large-scale workloads.
• Experience with AWS MWAA or Airflow orchestration.
• CI/CD and DevOps practices.

Responsibilities

• Design, build, and maintain scalable data pipelines on AWS.
• Develop data processing solutions using Python, Pandas, and PySpark.
• Orchestrate workflows with MWAA/Airflow.
• Query data with Athena to support analysis.
• Automate infrastructure with Terraform and GitHub Actions.
• Implement testing, monitoring, and data quality controls.
• Collaborate in an Agile environment and participate in code reviews.

Skills

Python

PySpark

AWS

Airflow

DevOps

Pandas

GitHub Actions

CI/CD

Gen AI

MWAA

Tools

Terraform

GitHub Actions

Job description

EPAM Systems Inc. is seeking a hands-on Senior Data Engineer in Colombia to design, build, and support scalable data pipelines on AWS. You will leverage Python, Pandas, and PySpark to deliver robust data processing solutions and orchestrate workflows with MWAA.

Automate infrastructure with Terraform and GitHub Actions, and enforce data quality in an Agile setting. The role emphasizes production-grade engineering, DevOps practices, and collaboration with cross-functional teams on complex data