Data Engineer: Databricks & GCP ETL/ELT Pipelines

AgileEngine

Zaragoza

On-site

EUR 80,000 - 107,000

Full time

8 days ago

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Job summary

AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines, productionize agentic workflows, and integrate with Databricks, GCP, BigQuery, and Delta Lake environments.

You will build reusable data engineering frameworks, implement data quality checks, and optimize workloads for performance and reliability while collaborating with cross-functional teams to automate processes.

Qualifications

5+ years of hands-on Databricks and PySpark experience.
Advanced SQL and data-processing skills.
Hands-on GCP experience, especially BigQuery.
Experience with Delta Lake and data-lake architectures.
Production-grade data solutions delivery.
Strong analytical and troubleshooting abilities.
Understanding of testing, version control, deployment, and monitoring.
Upper-intermediate English.

Responsibilities

Design and optimize scalable ETL/ELT pipelines using Databricks, PySpark, and SQL.
Build and operationalize agentic workflows to automate data engineering tasks.
Integrate Databricks, GCP, BigQuery, and Delta Lake environments.
Develop pipelines and solutions for new business datasets.
Create reusable data engineering frameworks and components.
Implement data quality checks, monitoring, and production controls.
Optimize PySpark and SQL workloads for performance and reliability.
Support testing, deployment, and productionization of data solutions.
Troubleshoot complex data issues and implement sustainable fixes.
Collaborate with business, data engineering, and platform teams to identify more automation opportunities.