Data Engineer: Databricks, PySpark & GCP | Flexible/Remote

AgileEngine, LLC.; Alicante; Hybrid; EUR 65,000 - 95,000; Full time

Benefits offered by this job

Professional growth

Competitive USD-based compensation

Exciting projects

Flextime

Job summary

AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation. You will design, implement, and optimize pipelines using Databricks, PySpark, SQL, and BigQuery, integrate Delta Lake environments, and collaborate with cross-functional teams to deliver reliable data solutions.

The role offers Flextime and opportunities to work on cutting-edge platforms for Fortune 500

Qualifications

• 5+ years of hands-on experience with Databricks and PySpark
• Advanced SQL and data-processing skills
• GCP experience, especially BigQuery
• Delta Lake and modern data lake architectures
• ETL/ELT, data pipeline design and performance optimization
• Production-grade data solutions experience
• Strong analytical and troubleshooting skills
• Software engineering practices: testing, version control, deployment, monitoring, and production support

Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operations.
• Integrate Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and processing solutions to support new business requirements and datasets.
• Build reusable data engineering frameworks across use cases.
• Implement data quality checks, monitoring, validation, and production controls.
• Optimize PySpark and SQL workloads for performance and scalability.
• Support testing, deployment, productionization, and enhancements of data solutions.
• Troubleshoot complex data and production issues; implement sustainable solutions.
• Collaborate with business, data engineering, and platform teams to identify automation opportunities.

Skills

Databricks

PySpark

SQL

BigQuery

Delta Lake

ETL/ELT

Data Pipelines

Performance

Troubleshooting

Production-grade

Job description

AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to develop scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation. You will design, implement, and optimize pipelines using Databricks, PySpark, SQL, and BigQuery, integrate Delta Lake environments, and collaborate with cross-functional teams to deliver reliable data solutions.

The role offers Flextime and opportunities to work on cutting-edge platforms for Fortune 500