Data Engineer — Databricks, GCP & Scalable ETL Pipelines

AgileEngine, LLC.; Valladolid; Híbrido; EUR 60.000 - 90.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Professional growth

Competitive compensation

Exciting projects

Flextime

Descripción de la vacante

AgileEngine, LLC. in Valladolid, Spain is seeking a Data Engineer with strong Databricks and GCP experience to design, build, and productionize scalable ETL/ELT pipelines and agentic workflows.

You will optimize PySpark and SQL workloads, integrate Delta Lake with BigQuery and other data platforms, develop reusable data engineering components, implement data quality checks, and collaborate with business and platform teams on automation opportunities.

Formación

• 5+ years hands-on Databricks and PySpark experience.
• Advanced SQL and data-processing skills.
• Hands-on GCP experience, especially BigQuery.
• Experience with Delta Lake and lakehouse architectures.
• Strong ETL/ELT design and data quality practices.
• Experience delivering production-grade data solutions.
• Strong analytical and troubleshooting skills.
• Knowledge of testing, version control, deployment, and monitoring.

Responsabilidades

• Design, develop, and optimize scalable ETL/ELT data pipelines.
• Build agentic workflows to automate data engineering tasks.
• Integrate with Databricks, GCP, BigQuery, and Delta Lake.
• Develop pipelines to support new data requirements.
• Create reusable data engineering frameworks.
• Implement data quality checks and production controls.
• Optimize PySpark and SQL workloads.
• Support testing, deployment, and productionization.
• Troubleshoot complex data and production issues.
• Collaborate with cross-functional teams to identify automation opportunities.

Conocimientos

Databricks PySpark

Advanced SQL

GCP BigQuery

Delta Lake

ETL/ELT design

Production-grade data

Data validation

Testing & monitoring

Data pipelines

Troubleshooting

Herramientas

Databricks

BigQuery

Delta Lake

Descripción del empleo

AgileEngine, LLC. in Valladolid, Spain is seeking a Data Engineer with strong Databricks and GCP experience to design, build, and productionize scalable ETL/ELT pipelines and agentic workflows.

You will optimize PySpark and SQL workloads, integrate Delta Lake with BigQuery and other data platforms, develop reusable data engineering components, implement data quality checks, and collaborate with business and platform teams on automation opportunities.