Senior Azure Databricks Engineer - Data Platform (Dublin)

FalconSmartIT

Dublin

On-site

EUR 120,000 - 180,000

Part time

6 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

FalconSmartIT in Dublin, Ireland is seeking a Senior Azure Databricks Engineer to design, build, and optimize enterprise data platforms and pipelines. You will leverage Azure Databricks, Spark, PySpark, SQL, and Delta Lake to support analytics, reporting, and AI/ML use cases.

You will partner with data architects and business stakeholders to deliver scalable, secure data solutions, while mentoring junior engineers and contributing to CI/CD and IaC efforts in a fast-paced, enterprise environment.

Qualifications

Responsibilities

Design scalable data pipelines using Azure Databricks.
Develop PySpark, Spark SQL, and Python applications for large-scale data processing.
Build batch and near-real-time data pipelines.
Implement Delta Lake architectures and lakehouse patterns.
Develop data ingestion and transformation pipelines with ADF and Databricks.
Work with ADLS Gen2 for storage.
Design data models for analytics and reporting workloads.
Implement data quality, validation, monitoring, and error handling.
Optimize Spark jobs, clusters, and Delta tables.
Implement Unity Catalog for data governance.
Develop and manage Databricks workflows and production deployments.
Set up CI/CD pipelines using Azure DevOps or GitHub Actions.
Monitor pipelines and troubleshoot performance and data quality issues.
Collaborate on data engineering standards and best practices.
Mentor junior engineers and participate in code reviews.