Data Engineer: Databricks, PySpark & GCP, Flexible

AgileEngine, LLC.; Madrid; Hybrid; EUR 65,000 - 90,000; Full time

Benefits offered by this job

Flextime

Professional growth

Competitive compensation

Exciting projects

Job summary

AgileEngine, based in Madrid, Spain, is seeking a Data Engineer with strong Databricks and GCP experience to design and productionize scalable ETL/ELT pipelines and agentic workflows for data automation.

You will design and optimize pipelines with Databricks, PySpark, and SQL, integrate with BigQuery and Delta Lake, and deliver production-grade data solutions across multiple datasets and use cases.

Qualifications

• 5+ years of hands-on Databricks and PySpark experience.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operational processes such as data validation, issue identification, troubleshooting, and workflow execution.

Skills

Databricks

PySpark

Advanced SQL

ETL/ELT

Data pipeline design

Delta Lake

GCP BigQuery

Data quality

Troubleshooting

Production support

Tools

BigQuery

Delta Lake

GCP

Job description

AgileEngine, based in Madrid, Spain, is seeking a Data Engineer with strong Databricks and GCP experience to design and productionize scalable ETL/ELT pipelines and agentic workflows for data automation.

You will design and optimize pipelines with Databricks, PySpark, and SQL, integrate with BigQuery and Delta Lake, and deliver production-grade data solutions across multiple datasets and use cases.