Data Engineer: Build Pipelines with Python & Airflow

EPAM Systems; Colombia; Presencial; COP 72.000.000 - 144.000.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

International projects with top brands

Work with global teams of highly skll\

Descripción de la vacante

EPAM Systems in Colombia is seeking a data engineer to architect, build and support scalable data pipelines using Python, Google BigQuery and Apache Airflow.

You will collaborate with stakeholders to translate data requirements into robust ETL/ELT processes, ensure data quality and performance, and participate in code reviews and Agile ceremonies.

The role emphasizes strong SQL skills, data governance, security, and documentation within a cross-functional, global team.

Formación

• Minimum 2 years of professional experience in data engineering.
• Strong Python development for data engineering and automation.
• Hands-on experience with Google BigQuery including data modeling and tuning.
• Practical background in designing and supporting Apache Airflow workflows.
• Solid understanding of ETL/ELT concepts and modern data architectures.
• Proficient SQL skills with large-scale datasets.
• Experience integrating data from APIs, databases, and cloud services.
• Understanding of data warehousing concepts and dimensional modeling.
• Experience with Git for version control.
• Familiarity with CI/CD and deployment automation.
• Strong analytical thinking and troubleshooting.
• Good communication and collaboration in cross-functional teams.
• Experience in Agile/Scrum environments.
• English at B2 level or higher with strong written and spoken communication.

Responsabilidades

• Architect, build, and support scalable data pipelines along with ETL/ELT processes.
• Construct and refine data solutions leveraging Google BigQuery.
• Create data processing and automation workflows with Python.
• Set up, schedule, monitor, and diagnose workflows using Apache Airflow.
• Safeguard data quality, reliability, and consistency across data sources.
• Fine-tune query performance, storage usage, and overall platform efficiency.
• Work with business and technical stakeholders to capture data requirements and turn them into scalable solutions.
• Put in place monitoring, alerting, and operational best practices for data pipelines.
• Contribute to data governance, security, and compliance initiatives.
• Add to technical documentation, knowledge sharing, and engineering best practices.
• Take part in code reviews, design discussions, and Agile ceremonies.

Conocimientos

Python

SQL

Agile/Scrum

English (B2+)

Analytical thinking

Herramientas

Google BigQuery

Apache Airflow

Docker

Git

CI/CD

Descripción del empleo

EPAM Systems in Colombia is seeking a data engineer to architect, build and support scalable data pipelines using Python, Google BigQuery and Apache Airflow.

You will collaborate with stakeholders to translate data requirements into robust ETL/ELT processes, ensure data quality and performance, and participate in code reviews and Agile ceremonies.

The role emphasizes strong SQL skills, data governance, security, and documentation within a cross-functional, global team.