Databricks Data Engineer

TechShack; Dublin; Hybrid; EUR 90,000 - 130,000; Full time

Job summary

TechShack is partnering with a leading North Dublin organisation to hire an experienced Databricks Data Engineer on a 12-month B2B contract. You will design, build and optimise modern data pipelines on Databricks, delivering reliable, scalable solutions for business decisions.

You’ll work 3–4 days onsite in North Dublin, collaborating with stakeholders to translate needs into data products and maintain quality, governance and CI/CD practices across the data platform.

Qualifications

• Hands-on Databricks delivery in production systems.

Responsibilities

• Design, build and maintain scalable data pipelines on Databricks.

Skills

Databricks delivery

Python/PySpark

SQL

Delta Lake

Lakehouse architecture

Cloud platforms

Unity Catalog/Delta Live Tables

CI/CD/Git/IaC

Stakeholder communication

Onsite North Dublin

Tools

Terraform

Git

Job description

Location: North Dublin, Ireland (Hybrid)

Contract: B2B, 12 months

TechShack is partnering with a leading organisation in North Dublin to find an experienced Databricks Data Engineer for a 12-month B2B contract. You’ll join a growing data team to design, build and optimise modern data platforms on Databricks, delivering reliable, scalable pipelines that drive key business decisions.

What you’ll be doing

• Designing, building and maintaining scalable data pipelines on Databricks
• Developing ETL/ELT processes with PySpark, Spark SQL and Delta Lake
• Putting Lakehouse architecture and Medallion (Bronze, Silver, Gold) design patterns in place
• Working with stakeholders to turn business needs into strong data solutions
• Tuning Spark jobs and Databricks clusters for performance and cost
• Setting up data quality, governance and security best practice, including Unity Catalog
• Building CI/CD pipelines and following engineering best practice across the data platform
• Supporting migration of legacy data workloads to Databricks

What we’re looking for

• Strong commercial experience as a Data Engineer with hands‑on Databricks delivery
• Advanced skills in Python/PySpark and SQL
• Solid experience with Delta Lake, Spark and Lakehouse architecture
• Experience with at least one major cloud platform (Azure, AWS or GCP)
• Knowledge of Unity Catalog, Databricks Workflows and Delta Live Tables
• Experience with CI/CD, Git and infrastructure as code (e.g. Terraform)
• Strong communication skills and confidence working directly with stakeholders
• Able to work onsite in North Dublin 3-4 days per week

Nice to have

• Databricks certifications (Data Engineer Professional)
• Experience with streaming data (Structured Streaming, Kafka, Event Hubs)
• Experience with dbt, Airflow or similar orchestration tools
• Background in consultancy or enterprise data delivery

Why apply?

• 12-month contract with a long-term, high-impact data programme
• Work with a modern Databricks Lakehouse stack
• Hybrid working with a collaborative onsite team in North Dublin
• ASAP start for the right candidate