Data Engineer - Databricks, PySpark & GCP (Remote/Flex)

Agileengine; Región Centro; Presencial; MXN 1.636.000 - 2.182.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive USD-based compensation

Exciting projects

Flextime

Descripción de la vacante

AgileEngine in Mexico is seeking a Data Engineer with strong Databricks and GCP experience to design and productionize scalable ETL/ELT pipelines and agentic workflows for data engineering automation.

You will build pipelines with PySpark, SQL, BigQuery, and Delta Lake, implement data quality checks, and collaborate with cross-functional teams to support new datasets and business requirements. English proficiency is required.

Formación

• 5+ years of hands-on Databricks and PySpark experience.
• Advanced SQL and data-processing skills.
• GCP experience, especially BigQuery.
• Delta Lake and modern data lake/lakehouse architectures.
• ETL/ELT design, performance optimization, and data quality.
• Production-grade data solutions experience.
• Strong analytical and troubleshooting abilities.
• Software engineering practices including testing, version control, deployment and monitoring.
• Upper-intermediate English level.

Responsabilidades

• Design, develop, and optimize scalable ETL/ELT pipelines using Databricks and PySpark.
• Build and operationalize agentic workflows for automated data processing.
• Integrate with Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop pipelines to support new datasets and business requirements.
• Create reusable data engineering frameworks and components.
• Implement data quality checks, monitoring, and production controls.
• Optimize PySpark and SQL workloads for performance and reliability.
• Support testing, deployment, and productionization of data solutions.
• Troubleshoot complex data issues and implement sustainable fixes.
• Collaborate with business, data, and platform teams to identify automation opportunities.

Conocimientos

Databricks

PySpark

SQL

GCP BigQuery

Delta Lake

ETL/ELT

Data pipelines

Data quality

Troubleshooting

English

Descripción del empleo

AgileEngine in Mexico is seeking a Data Engineer with strong Databricks and GCP experience to design and productionize scalable ETL/ELT pipelines and agentic workflows for data engineering automation.

You will build pipelines with PySpark, SQL, BigQuery, and Delta Lake, implement data quality checks, and collaborate with cross-functional teams to support new datasets and business requirements. English proficiency is required.