Data Engineer - Databricks, GCP & Automation Pipelines

Agileengine; Santiago de Querétaro; Híbrido; MXN 600.000 - 900.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Descripción de la vacante

AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data automation.

Design and optimize data pipelines using PySpark, SQL, and Delta Lake, while integrating with BigQuery and GCP environments. You will build reusable frameworks and ensure data quality, performance, and reliability across projects.

Formación

• 5+ years hands-on Databricks and PySpark experience.
• Advanced SQL and data-processing skills required.
• Hands-on with GCP, especially BigQuery, is a must.
• Experience with Delta Lake and data lake architectures.
• Strong ETL/ELT design, data quality, and performance optimization.

Responsabilidades

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operational processes.
• Integrate agentic capabilities with Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and processing solutions to support new business requirements and datasets.
• Build reusable frameworks and components across data engineering use cases.
• Implement data quality checks, monitoring, validation, and production controls.
• Optimize PySpark and SQL workloads for performance and reliability.
• Support testing, deployment, and productionization of data solutions.
• Troubleshoot complex data and production issues and implement sustainable solutions.
• Collaborate with business and platform teams to identify automation opportunities.

Conocimientos

Databricks PySpark

Advanced SQL

GCP BigQuery

Delta Lake

ETL/ELT

Production-grade data

Troubleshooting

Software engineering practices

Herramientas

SQL tooling

Descripción del empleo

AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data automation.

Design and optimize data pipelines using PySpark, SQL, and Delta Lake, while integrating with BigQuery and GCP environments. You will build reusable frameworks and ensure data quality, performance, and reliability across projects.