Data Engineer — Databricks & GCP, AI Workflows (Remote)

AgileEngine; Málaga; Hybrid; EUR 65,000 - 90,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Job summary

AgileEngine in Málaga, Spain is seeking a Data Engineer with Databricks and GCP experience to design scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.

You will build pipelines using Databricks, PySpark, SQL; integrate with BigQuery and Delta Lake; ensure data quality, performance, and reliability; collaborate across teams and contribute to reusable data frameworks.

Qualifications

• 5+ years hands-on Databricks and PySpark experience.
• Advanced SQL and data-processing skills.
• GCP experience, especially BigQuery.
• Delta Lake and modern data lakehouse architectures.
• ETL/ELT design, data pipelines, performance optimization, data quality.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operational processes.
• Integrate Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and processing solutions for new business requirements and datasets.
• Create reusable data frameworks and components for multiple use cases.
• Implement data quality checks, monitoring, validation, and production controls.
• Optimize PySpark and SQL workloads for performance and reliability.
• Support testing, deployment, productionization, and enhancement of data and agentic solutions.
• Troubleshoot complex data and production issues and implement sustainable solutions.
• Collaborate with business, data engineering, and platform teams to identify automation opportunities.

Skills

Databricks

PySpark

SQL

GCP

BigQuery

Delta Lake

ETL/ELT

Data pipelines

Data quality

Production ops

Tools

Databricks

GCP

BigQuery

Delta Lake

Job description

AgileEngine in Málaga, Spain is seeking a Data Engineer with Databricks and GCP experience to design scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.

You will build pipelines using Databricks, PySpark, SQL; integrate with BigQuery and Delta Lake; ensure data quality, performance, and reliability; collaborate across teams and contribute to reusable data frameworks.