Data Engineer: Databricks & GCP, Flexible + Remote

AgileEngine, LLC.; Barcelona; Hybrid; EUR 70,000 - 90,000; Full time

Benefits offered by this job

Flextime

Professional growth

Competitive compensation

Exciting projects

Job summary

AgileEngine is seeking a Data Engineer in a data-driven role focusing on scalable ETL/ELT pipelines built with Databricks, PySpark, and SQL. You will operationalize agentic workflows and integrate with GCP, BigQuery, and Delta Lake to support evolving data requirements.

The role emphasizes production-grade data solutions, data quality, and performance optimization, with opportunities to contribute across multiple data projects in a flexible work model.

Qualifications

• 5+ years hands-on Databricks and PySpark experience.
• Advanced SQL and data-processing skills.
• Experience with GCP, BigQuery, Delta Lake.
• Strong ETL/ELT design and data quality focus.
• Production-grade data solutions development and operations.
• Experience with testing, version control, deployment and monitoring.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operational processes.
• Integrate Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and processing solutions to support new business requirements.
• Build reusable data engineering frameworks and components across use cases.
• Implement data quality checks, monitoring, validation, and production controls.
• Optimize PySpark and SQL workloads for performance, reliability, and scalability.
• Support testing, deployment, productionization, and enhancement of data/agentic solutions.
• Troubleshoot complex data and production issues and implement sustainable solutions.
• Collaborate with business, data engineering, and platform teams to identify automation opportunities.

Skills

Databricks

PySpark

Advanced SQL

GCP

BigQuery

Delta Lake

ETL/ELT

Data quality

Production-grade data solutions

Testing

Version control

Deployment

Monitoring

Troubleshooting

Job description

AgileEngine is seeking a Data Engineer in a data-driven role focusing on scalable ETL/ELT pipelines built with Databricks, PySpark, and SQL. You will operationalize agentic workflows and integrate with GCP, BigQuery, and Delta Lake to support evolving data requirements.

The role emphasizes production-grade data solutions, data quality, and performance optimization, with opportunities to contribute across multiple data projects in a flexible work model.