Data Engineer: Databricks & GCP | Hybrid Work & Growth
AgileEngine
Get a reply from this employer
Your resume and cover letter, tailored to exactly what they’re hiring for.
Benefits offered by this job
Job summary
AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation in Valladolid, Spain.
You will build pipelines using PySpark and SQL, integrate Delta Lake, help optimize workloads, and collaborate with cross-functional teams to drive data initiatives for Fortune 500 clients.
Qualifications
- 5+ years hands-on Databricks and PySpark experience.
- Advanced SQL and data-processing skills.
- GCP experience, especially BigQuery, is required.
- Experience with Delta Lake and modern lakehouse architectures.
- Proven ability to design scalable ETL/ELT pipelines with data quality checks.
Responsibilities
- Design, develop, and optimize scalable ETL/ELT data pipelines.
- Build and operationalize agentic workflows for automation.
- Integrate with Databricks, GCP, BigQuery, and Delta Lake.
- Develop data pipelines to support new business requirements.
- Create reusable data engineering frameworks and components.
- Implement data quality checks and production controls.
- Optimize PySpark and SQL workloads for performance.
- Collaborate with cross-functional teams to identify automation opportunities.
Skills
Tools
Job description
AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation in Valladolid, Spain.
You will build pipelines using PySpark and SQL, integrate Delta Lake, help optimize workloads, and collaborate with cross-functional teams to drive data initiatives for Fortune 500 clients.
'/%3e%3cpath%20d='M101.744%2012.4726L102.894%2016.1947L99.0021%2013.2201L101.744%2012.4726ZM105.3%208.40937H100.488L99.0026%203.59473L97.5116%208.41047L92.7%208.40385L96.5965%2011.3834L95.1055%2016.1942L99.0021%2013.2196L101.408%2011.3834L105.3%208.40992V8.40937Z'%20fill='white'/%3e%3cdefs%3e%3clinearGradient%20id='paint0_linear_5593_1381'%20x1='90'%20y1='9.44471'%20x2='99'%20y2='9.44471'%20gradientUnits='userSpaceOnUse'%3e%3cstop%20stop-color='%2300AD70'/%3e%3cstop%20offset='0.998594'%20stop-color='%2300B67A'/%3e%3cstop%20offset='1'%20stop-color='%23DCDCE6'/%3e%3c/linearGradient%3e%3c/defs%3e%3c/svg%3e){kind=small}
