Data Engineer - AI-Driven Data Pipelines

Bain & Company; Ciudad de México; Presencial; MXN 900.000 - 1.500.000; Jornada completa

Descripción de la vacante

Bain & Company seeks a Data Engineer to join the Coro team within NGSS, building and maintaining Python-based data pipelines and services that power Coro's data platform. You will work across analytics, engineering, and business teams to deliver reliable data products.

Responsibilities include designing batch/streaming pipelines, deploying in the cloud, and implementing data quality checks, testing, and CI/CD. The role emphasizes scalable, well-tested code and strong collaboration.

Formación

• Experience shipping production Python
• Experience building and operating ETL/ELT pipelines at scale
• Knowledge of Python data tooling (pandas, Polars, PyArrow, DuckDB, PySpark)
• Schema enforcement and validation tools (e.g., Pydantic)
• Workflow orchestration in code (Airflow, Dagster, Prefect, dbt, Temporal)
• Testing and quality tooling (pytest, pyright, ty, pyrefly, ruff or black)
• Dependency and environment management (uv, Poetry, pip-tools, conda)
• Public cloud platforms and Python SDKs (AWS/Azure/GCP)
• SQL data modeling, governance, privacy practices

Responsabilidades

• Design, build, and maintain batch and streaming Python pipelines.
• Write reusable Python libraries and internal packages to be used by others.
• Develop Python services/APIs that expose data and integrate with APIs.
• Write tests and maintain CI for pipelines.
• Profile and optimize Python code and data processing jobs.
• Deploy and operate code in the cloud using containers and CI/CD.
• Enforce data security and access controls across lifecycles.
• Identify and fix performance, reliability, and cost issues in pipelines.
• Replace scripts with tested, packaged production code.
• Implement data quality checks and monitoring.

Conocimientos

Python development

ETL/ELT pipelines

SQL

Testing

Data modeling

Debugging & profiling

Code quality & API design

Educación

Bachelor's degree

Herramientas

pandas

Polars

PyArrow

DuckDB

PySpark

Airflow

Dagster

Prefect

dbt

Temporal

Terraform

GitHub Actions

Kubernetes

Descripción del empleo

Bain & Company seeks a Data Engineer to join the Coro team within NGSS, building and maintaining Python-based data pipelines and services that power Coro's data platform. You will work across analytics, engineering, and business teams to deliver reliable data products.

Responsibilities include designing batch/streaming pipelines, deploying in the cloud, and implementing data quality checks, testing, and CI/CD. The role emphasizes scalable, well-tested code and strong collaboration.