Senior Azure Databricks Engineer: Data Platform Lead

Falcon Smart IT Limited; Dublin; On-site; EUR 90,000 - 120,000; Full time

Job summary

Falcon Smart IT Limited in Dublin is seeking a Senior Azure Databricks Engineer to design, develop, and optimize enterprise data platforms using Azure Databricks, Spark, PySpark, SQL, ADLS Gen2, and ADF.

You will collaborate with data architects, analysts, and stakeholders to deliver data solutions supporting analytics, reporting, and AI/ML use cases, implement Unity Catalog, and mentor junior engineers.

Qualifications

• 7+ years of data engineering experience with Azure Databricks.
• Hands-on with Spark, PySpark and Delta Lake.
• Proficiency in SQL and Python for large-scale data processing.
• Experience with Unity Catalog and data governance.

Responsibilities

• Design and build scalable data pipelines on Azure Databricks.
• Develop high-performance PySpark and Spark SQL applications.
• Maintain batch and near-real-time data flows and Delta tables.
• Implement CI/CD and IaC for production pipelines.

Skills

Azure Databricks

PySpark

SQL

Python

Delta Lake

Spark

Data Modeling

CI/CD

Git

Education

Bachelor's or Master's in Computer Science / Engineering / IT

Tools

Databricks Workflows

Azure DevOps

GitHub Actions

Terraform

Azure Data Factory

Unity Catalog

Job description

Falcon Smart IT Limited in Dublin is seeking a Senior Azure Databricks Engineer to design, develop, and optimize enterprise data platforms using Azure Databricks, Spark, PySpark, SQL, ADLS Gen2, and ADF.

You will collaborate with data architects, analysts, and stakeholders to deliver data solutions supporting analytics, reporting, and AI/ML use cases, implement Unity Catalog, and mentor junior engineers.