Data Engineer: Databricks + GCP ETL & AI Workflows

AgileEngine, LLC.; Województwo pomorskie; Hybride; PLN 180 000 - 260 000; Plein temps

Avantages offerts par ce poste

Professional growth

Competitive compensation (USD-based)

Exciting projects

Flextime & remote

Résumé du poste

AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines and productionize agentic workflows for data automation. You will build reliable, production-grade data solutions using Delta Lake, PySpark, and Advanced SQL, integrating with BigQuery and orchestrating end-to-end data processing.

Collaborate with business, data engineering, and platform teams to identify automation opportunities and deliver high-impact data platforms for Fortune

Qualifications

• 5+ years of hands-on Databricks and PySpark experience.
• Advanced SQL and data-processing skills.
• Hands-on GCP experience, especially BigQuery.
• Experience with Delta Lake and modern data lake architectures.
• Strong ETL/ELT design, data pipelines, performance optimization, and data quality.
• Experience building reliable, scalable production-grade data solutions.
• Strong analytical and troubleshooting skills.
• Knowledge of software engineering practices (testing, version control, deployment, monitoring).

Responsabilités

• Design, develop, and optimize scalable ETL/ELT data pipelines using Databricks, PySpark, and SQL.
• Build and operationalize agentic workflows to automate data engineering processes.
• Integrate agentic capabilities with Databricks, GCP, BigQuery, and Delta Lake environments.
• Develop data pipelines and processing solutions for new business requirements.
• Create reusable frameworks and components for data engineering use cases.
• Implement data quality checks, monitoring, and production controls.
• Optimize PySpark and SQL workloads for performance and reliability.
• Support testing, deployment, productionization, and ongoing enhancements.
• Troubleshoot complex data and production issues and implement sustainable solutions.
• Collaborate with cross-functional teams to identify automation opportunities.

Connaissances

Databricks

PySpark

SQL

GCP BigQuery

Delta Lake

ETL/ELT design

Data quality

Production-grade data solutions

Testing & deployment

Troubleshooting

Outils

Git

Description du poste

AgileEngine is seeking a Data Engineer with strong Databricks and GCP experience to design scalable ETL/ELT pipelines and productionize agentic workflows for data automation. You will build reliable, production-grade data solutions using Delta Lake, PySpark, and Advanced SQL, integrating with BigQuery and orchestrating end-to-end data processing.

Collaborate with business, data engineering, and platform teams to identify automation opportunities and deliver high-impact data platforms for Fortune