Data Engineer: Databricks & GCP Pipelines Maestro

AgileEngine, LLC.; Málaga; Híbrido; EUR 60.000 - 80.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Descripción de la vacante

AgileEngine is looking for a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.

You will design and optimize pipelines, integrate with Databricks, GCP, BigQuery and Delta Lake, and build reusable components for multiple data use cases. Join a people-first team in Málaga, offering flextime and hybrid work.

Formación

• 5+ years hands-on Databricks/PySpark experience
• Advanced SQL and data-processing skills
• GCP experience, BigQuery emphasis
• Delta Lake and modern lakehouse architectures
• Strong ETL/ELT design, performance optimization
• Experience building scalable, production-grade data solutions
• Strong analytical and troubleshooting skills
• Familiarity with testing, version control, deployment, monitoring

Responsabilidades

• Design, develop, and optimize scalable ETL/ELT pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and processes.
• Integrate Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines to support new business requirements and datasets.
• Create reusable data engineering frameworks and components.
• Implement data quality checks, monitoring, and production controls.
• Optimize PySpark and SQL workloads for performance and reliability.
• Support testing, deployment, and productionization of data solutions.
• Troubleshoot complex data and production issues and implement sustainable solutions.
• Collaborate with business and platform teams to identify automation opportunities.

Conocimientos

Databricks PySpark

Advanced SQL

GCP BigQuery

Delta Lake

ETL/ELT design

Production-grade data solutions

Troubleshooting

Software engineering practices

Data quality checks

Descripción del empleo

AgileEngine is looking for a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.

You will design and optimize pipelines, integrate with Databricks, GCP, BigQuery and Delta Lake, and build reusable components for multiple data use cases. Join a people-first team in Málaga, offering flextime and hybrid work.