Data Engineer - Databricks & GCP Pipelines (Remote, Flextime)

AgileEngine, LLC.; Valladolid; Hybrid; EUR 65,000 - 95,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Job summary

AgileEngine in Valladolid, Spain, is seeking a Data Engineer with strong Databricks and GCP experience to build scalable ETL/ELT pipelines and productionize agentic workflows for data automation.

You will design and optimize data pipelines, integrate with Databricks, GCP, BigQuery, and Delta Lake, and develop reusable components to support multiple data use cases. This role emphasizes quality, performance, and reliable data solutions.

Qualifications

• 5+ years designing and building data pipelines with Databricks and PySpark.
• Extensive SQL skills and ability to optimize queries for large datasets.
• Experience in GCP, BigQuery, Delta Lake, and modern lakehouse architectures.
• Strong understanding of ETL/ELT, data quality, and production-grade data solutions.
• Troubleshooting complex data workflows with scalable, reliable approaches.
• Familiarity with testing, version control, deployment, monitoring, and support.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operational processes.
• Integrate agentic capabilities with Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and processing solutions to support new business requirements.
• Build reusable data engineering frameworks and platform components.
• Implement data quality checks, monitoring, and production controls.
• Optimize PySpark and SQL workloads for performance and reliability.
• Support testing, deployment, productionization, and ongoing enhancement of data solutions.
• Troubleshoot complex data and production issues and implement sustainable fixes.
• Collaborate with business, data engineering, and platform teams to identify automation opportunities.

Skills

Databricks & PySpark

SQL proficiency

Analytical troubleshooting

Data pipeline design

Tools

Databricks

PySpark

GCP BigQuery

Delta Lake

Job description

AgileEngine in Valladolid, Spain, is seeking a Data Engineer with strong Databricks and GCP experience to build scalable ETL/ELT pipelines and productionize agentic workflows for data automation.

You will design and optimize data pipelines, integrate with Databricks, GCP, BigQuery, and Delta Lake, and develop reusable components to support multiple data use cases. This role emphasizes quality, performance, and reliable data solutions.