Senior Data Engineer

EPAM Systems Inc; México; A distancia; MXN 800.000 - 1.200.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Healthcare benefits

Paid time off

Descripción de la vacante

EPAM Systems Inc. is seeking a hands-on Senior Data Engineer to design, build, and support scalable data pipelines and cloud-based data solutions on AWS. You will orchestrate workflows with MWAA, optimize queries in Athena, and automate infrastructure with Terraform and GitHub Actions.

You will work in an Agile environment, collaborating with engineering, product, and business teams to ensure production-quality delivery and robust data quality controls.

Formación

• Minimum 3 years of relevant professional experience.
• Strong core Python programming skills for building data engineering solutions.
• Hands-on experience with Python Pandas for data manipulation and analysis.
• Proficiency in PySpark for processing large-scale distributed data.
• Experience with AWS MWAA or Apache Airflow for orchestrating data workflows.
• Working knowledge of AWS Athena for querying data stored in AWS.
• Experience using Terraform to automate infrastructure provisioning.
• Familiarity with GitHub Actions for CI/CD workflows.
• Solid understanding of DevOps practices applied to data engineering environments.
• Upper-intermediate English language skills (B1).

Responsabilidades

• Design, build, and maintain scalable data pipelines deployed on AWS.
• Build and manage workflows through AWS Managed Workflows for Apache Airflow (MWAA).
• Develop and optimize data queries using AWS Athena.
• Automate infrastructure provisioning and deployment processes using Terraform and GitHub Actions.
• Implement testing, monitoring, troubleshooting, and data-quality controls.
• Participate in code reviews and promote engineering best practices.
• Collaborate with engineering, product, and business teams in an Agile environment.

Conocimientos

Python

Pandas

PySpark

AWS

Airflow

DevOps

Data pipelines

CI/CD

Agile

English (B1+)

Herramientas

MWAA

Terraform

GitHub Actions

Athena

Descripción del empleo

We are looking for a hands-on Senior Data Engineer to build and support scalable data pipelines and cloud-based data solutions. The ideal candidate will have strong experience in Python, PySpark, AWS, Airflow, and DevOps, with a focus on production-quality engineering and automationResponsibilitiesDesign, build, and maintain scalable data pipelines deployed on AWSDevelop robust data processing solutions using Python, Pandas, and PySparkBuild and manage workflows through AWS Managed Workflows for Apache Airflow (MWAA)Develop and optimize data queries using AWS Athena to support efficient data analysisAutomate infrastructure provisioning and deployment processes using Terraform and GitHub ActionsImplement testing, monitoring, troubleshooting, and data-quality controls to ensure pipeline reliabilityParticipate in code reviews and help drive strong engineering best practices across the teamCollaborate with engineering, product, and business teams within an Agile environmentRequirementsA minimum of 3 years of relevant professional experienceStrong core Python programming skills for building data engineering solutionsHands-on experience with Python Pandas for data manipulation and analysisProficiency in PySpark for processing large-scale distributed dataExperience with AWS MWAA or Apache Airflow for orchestrating and managing data workflowsWorking knowledge of AWS Athena for querying and analyzing data stored in AWSExperience using Terraform to automate infrastructure provisioning and managementFamiliarity with GitHub Actions for building automated CI/CD workflowsSolid understanding of DevOps practices applied to data engineering environmentsStrong data engineering, debugging, and problem-solving skillsUpper-intermediate English language skills or higher (B1)Nice to haveExperience using GitHub Copilot to support development, code reviews, testing, and release managementFamiliarity with CI/CD practices and tooling for streamlined software deliveryExperience working within Agile/Scrum environmentsBackground in financial services or investment management industriesExperience with Gen AI application development and applying Gen AI within the software development lifecycle (SDLC)We offerInternational projects with top brandsWork with global teams of highly skilled, diverse peersHealthcare benefitsEmployee financial programsPaid time off and sick leaveUpskilling, reskilling and certification coursesUnlimited access to the LinkedIn Learning library and 22,000+ coursesGlobal career opportunitiesVolunteer and community involvement opportunitiesEPAM Employee GroupsAward-winning culture recognized by Glassdoor, Newsweek and LinkedInEPAM is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, age, sexual orientation, gender identity or expression, disability, protected veteran status, or any other characteristic protected by applicable law.