Senior Data Engineer - Databricks ETL & Master Data

Intuition IT Solutions

Ireland

On-site

EUR 90,000 - 130,000

Full time

34 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Intuition IT Solutions is seeking a senior Data Engineer to lead the design and delivery of Databricks-based ETL pipelines for manufacturing data. You will profile raw data, implement data quality checks, and build bronze/silver datasets aligned to enterprise standards.

Your role includes master data governance and KPI modeling to support insights and reporting. The position requires strong Python/SQL skills, hands-on Databricks experience, and the ability to mentor teams within an Agile/DevOps

Qualifications

  • Bachelor’s degree in Computer Science or related field; equivalent experience may be considered.
  • 7+ years of data engineering experience with data onboarding and modelling deliveries.
  • Advanced hands-on Python and SQL skills, with strong software-engineering practices for modular, testable data solutions.
  • Strong practical experience with Databricks, Apache Spark, notebook-based development, Delta Lake or equivalent lakehouse patterns, and performance optimisation.
  • Demonstrated experience designing scalable ETL/ELT pipelines and layered bronze and silver data products using reusable engineering patterns.
  • Experience designing master data, dimensional, asset-centric, aggregation, and time-series models for analytics and reporting.
  • Strong understanding of data quality, metadata, lineage, reconciliation, observability, access controls, and production support.
  • Experience working with manufacturing and operational data, including batch, product, material, equipment, process, quality, and performance data.
  • Experience with manufacturing execution systems (MES), SAP, historians, laboratory or quality systems, and industrial analytics environments is highly desirable.
  • Knowledge of manufacturing KPIs and the underlying business rules for yield, cycle time, deviations, process performance, and trend-based analysis is highly desirable.
  • Experience with source control, CI/CD, automated testing, agile delivery, and regulated or validated data environments is preferred.
  • Strong analytical, problem-solving, stakeholder-management, and written and verbal communication skills, with the ability to translate operational requirements into robust technical solutions.

Responsibilities

  • Analyse and profile raw manufacturing and operational data to identify data quality issues and onboarding needs.
  • Design, build, test, and maintain scalable Python-based Databricks ETL notebooks and pipelines.
  • Create reusable bronze and silver datasets conforming to enterprise data architecture.
  • Develop a master data framework aligning products, materials, equipment, and processes.
  • Build KPI calculation frameworks for yield, cycle time, deviations, and process performance.
  • Develop aggregated performance models for trend analysis and reporting.
  • Collaborate with cross-functional teams to validate data and metrics.
  • Implement automated data-quality checks, monitoring, and exception handling.
  • Document mappings, transformation logic, data lineage, and deployment procedures.
  • Work within agile and DevOps practices including CI/CD and production support.
  • Provide technical leadership and mentoring to the delivery team.

Skills

Analytical thinking
Problem-solving
Stakeholder management
Communication skills
Technical leadership
Translate requirements

Education

Bachelor’s degree in Computer Science
Data Engineering experience

Tools

Python
SQL
Databricks
Apache Spark
Delta Lake
Git
CI/CD

Job description

Intuition IT Solutions is seeking a senior Data Engineer to lead the design and delivery of Databricks-based ETL pipelines for manufacturing data. You will profile raw data, implement data quality checks, and build bronze/silver datasets aligned to enterprise standards.

Your role includes master data governance and KPI modeling to support insights and reporting. The position requires strong Python/SQL skills, hands-on Databricks experience, and the ability to mentor teams within an Agile/DevOps

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer with Manufacturing
Senior Data Engineer with Manufacturing

Intuition IT Solutions • Ireland

On-site
EUR 90,000 - 130,000
Senior Data Engineer: Databricks & AI Pipelines
Senior Data Engineer: Databricks & AI Pipelines

Expleo Group • Dublin

On-site
EUR 90,000 - 130,000
Competitive salary
Medical and dental insurance
Pension
+1
Senior Data Engineer
Senior Data Engineer

PlayStation • Ireland

On-site
EUR 90,000 - 130,000
Data Engineer (Databricks)
Data Engineer (Databricks)

ELLIOTT MOSS CONSULTING PTE. LTD. • Dublin

On-site
EUR 140,000 - 210,000
Principal Data Engineer
Principal Data Engineer

Expleo Group • Dublin

On-site
EUR 90,000 - 140,000
Senior Data Engineer — Cloud Data Platform & Pipelines
Senior Data Engineer — Cloud Data Platform & Pipelines

Mastercard Inc. • Donabate

On-site
EUR 90,000 - 130,000
Senior Data Engineer - Databricks Lakehouse & AI Pipelines
Senior Data Engineer - Databricks Lakehouse & AI Pipelines

Expleo Group • Dublin

On-site
EUR 90,000 - 140,000
Senior Data Engineer
Senior Data Engineer

G MASS Consulting • Dublin

On-site
EUR 90,000 - 130,000
Senior Data Engineer - Databricks & Azure Lakehouse
Senior Data Engineer - Databricks & Azure Lakehouse

Acuity • Cork

On-site
EUR 90,000 - 150,000
Databricks Enablement Team Lead
Databricks Enablement Team Lead

G MASS • Dublin

Hybrid
EUR 150,000 - 190,000
Top locations