Senior Azure Databricks Engineer: Data Platform Lead

东莞群福塑胶制品有限公司; Dublin; Vor Ort; EUR 90.000 - 120.000; Vollzeit

Zusammenfassung

Falcon Smart IT Limited in Dublin is seeking a Senior Azure Databricks Engineer to design, develop, and optimize enterprise data platforms using Azure Databricks, Spark, PySpark, SQL, ADLS Gen2, and ADF.

You will collaborate with data architects, analysts, and stakeholders to deliver data solutions supporting analytics, reporting, and AI/ML use cases, implement Unity Catalog, and mentor junior engineers.

Qualifikationen

• 7+ years of data engineering experience with Azure Databricks.
• Hands-on with Spark, PySpark and Delta Lake.
• Proficiency in SQL and Python for large-scale data processing.
• Experience with Unity Catalog and data governance.

Aufgaben

• Design and build scalable data pipelines on Azure Databricks.
• Develop high-performance PySpark and Spark SQL applications.
• Maintain batch and near-real-time data flows and Delta tables.
• Implement CI/CD and IaC for production pipelines.

Kenntnisse

Azure Databricks

PySpark

SQL

Python

Delta Lake

Spark

Data Modeling

CI/CD

Git

Ausbildung

Bachelor's or Master's in Computer Science / Engineering / IT

Tools

Databricks Workflows

Azure DevOps

GitHub Actions

Terraform

Azure Data Factory

Unity Catalog

Jobbeschreibung

Falcon Smart IT Limited in Dublin is seeking a Senior Azure Databricks Engineer to design, develop, and optimize enterprise data platforms using Azure Databricks, Spark, PySpark, SQL, ADLS Gen2, and ADF.

You will collaborate with data architects, analysts, and stakeholders to deliver data solutions supporting analytics, reporting, and AI/ML use cases, implement Unity Catalog, and mentor junior engineers.