Data Engineer: Databricks, GCP & AI-Driven Workflows

AgileEngine, LLC.; Aveiro; On-site; EUR 40,000 - 70,000; Full time

Benefits offered by this job

Professional growth

Competitive compensation

Exciting projects

Flextime (WFH/Office)

Job summary

AgileEngine, LLC. is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.

You will collaborate with cross-functional teams to implement reliable data solutions. Join a people-first culture with opportunities to work on cutting-edge AI/ML initiatives, modern data lake architectures, and high-visibility projects for Fortune 500 brands and startups.

Qualifications

• 5+ years of hands-on Databricks and PySpark experience.
• Advanced SQL and data-processing skills required.
• Experience with GCP, especially BigQuery.
• Experience with Delta Lake and modern lakehouse architectures.
• Strong ETL/ELT and data pipeline design skills.
• Experience building reliable, scalable data solutions.

Responsibilities

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering and operational processes.
• Integrate agentic capabilities with Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and processing solutions to support new business requirements.
• Build reusable frameworks and components for data engineering use cases.
• Implement data quality checks, monitoring, validation, and production controls.
• Troubleshoot complex data and production issues and implement sustainable solutions.
• Collaborate with business, data engineering, and platform teams to identify automation opportunities.

Skills

Databricks

PySpark

SQL

BigQuery

Delta Lake

ETL/ELT

Data pipelines

Data quality

Troubleshooting

Version control

Tools

GCP

Job description

AgileEngine, LLC. is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines and productionize agentic workflows for data engineering automation.

You will collaborate with cross-functional teams to implement reliable data solutions. Join a people-first culture with opportunities to work on cutting-edge AI/ML initiatives, modern data lake architectures, and high-visibility projects for Fortune 500 brands and startups.