Senior Data Engineer with Manufacturing

Intuition IT Solutions

Ireland

On-site

EUR 90,000 - 130,000

Full time

34 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Intuition IT Solutions is seeking a senior Data Engineer to lead the design and delivery of Databricks-based ETL pipelines for manufacturing data. You will profile raw data, implement data quality checks, and build bronze/silver datasets aligned to enterprise standards.

Your role includes master data governance and KPI modeling to support insights and reporting. The position requires strong Python/SQL skills, hands-on Databricks experience, and the ability to mentor teams within an Agile/DevOps

Qualifications

  • Bachelor’s degree in Computer Science or related field; equivalent experience may be considered.
  • 7+ years of data engineering experience with data onboarding and modelling deliveries.
  • Advanced hands-on Python and SQL skills, with strong software-engineering practices for modular, testable data solutions.
  • Strong practical experience with Databricks, Apache Spark, notebook-based development, Delta Lake or equivalent lakehouse patterns, and performance optimisation.
  • Demonstrated experience designing scalable ETL/ELT pipelines and layered bronze and silver data products using reusable engineering patterns.
  • Experience designing master data, dimensional, asset-centric, aggregation, and time-series models for analytics and reporting.
  • Strong understanding of data quality, metadata, lineage, reconciliation, observability, access controls, and production support.
  • Experience working with manufacturing and operational data, including batch, product, material, equipment, process, quality, and performance data.
  • Experience with manufacturing execution systems (MES), SAP, historians, laboratory or quality systems, and industrial analytics environments is highly desirable.
  • Knowledge of manufacturing KPIs and the underlying business rules for yield, cycle time, deviations, process performance, and trend-based analysis is highly desirable.
  • Experience with source control, CI/CD, automated testing, agile delivery, and regulated or validated data environments is preferred.
  • Strong analytical, problem-solving, stakeholder-management, and written and verbal communication skills, with the ability to translate operational requirements into robust technical solutions.

Responsibilities

  • Analyse and profile raw manufacturing and operational data to identify data quality issues and onboarding needs.
  • Design, build, test, and maintain scalable Python-based Databricks ETL notebooks and pipelines.
  • Create reusable bronze and silver datasets conforming to enterprise data architecture.
  • Develop a master data framework aligning products, materials, equipment, and processes.
  • Build KPI calculation frameworks for yield, cycle time, deviations, and process performance.
  • Develop aggregated performance models for trend analysis and reporting.
  • Collaborate with cross-functional teams to validate data and metrics.
  • Implement automated data-quality checks, monitoring, and exception handling.
  • Document mappings, transformation logic, data lineage, and deployment procedures.
  • Work within agile and DevOps practices including CI/CD and production support.
  • Provide technical leadership and mentoring to the delivery team.

Skills

Analytical thinking
Problem-solving
Stakeholder management
Communication skills
Technical leadership
Translate requirements

Education

Bachelor’s degree in Computer Science
Data Engineering experience

Tools

Python
SQL
Databricks
Apache Spark
Delta Lake
Git
CI/CD

Job description

  • Analyse and profile raw manufacturing and operational data from the external site, identifying source-system structures, data-quality issues, dependencies, and onboarding requirements.
  • Design, build, test, and maintain scalable Python-based Databricks ETL notebooks and pipelines for ingestion, transformation, validation, and publishing.
  • Create reusable CDL bronze and silver asset-centric datasets that conform to enterprise data architecture, engineering, metadata, security, and quality standards.
  • Develop a flexible master data framework that consistently aligns products, materials, equipment, processes, batches, and relevant manufacturing reference data.
  • Build governed KPI calculation frameworks for yield, cycle time, process deviations, and other agreed product and manufacturing-process performance measures.
  • Develop aggregated performance models that support trend analysis and reporting over time, enabling insights into operational efficiency and product performance.
  • Partner with manufacturing, quality, business, analytics, and source-system subject-matter experts to define requirements, validate business rules, and confirm the fitness of delivered datasets and metrics.
  • Implement automated data-quality checks, reconciliation, monitoring, logging, and exception handling to ensure reliable and traceable data products.
  • Optimise pipeline performance, reusability, and maintainability, and document source mappings, transformation logic, data lineage, KPI definitions, and operational support procedures.
  • Work within agile delivery and DevOps practices, including source control, peer review, automated testing, release management, and production support.
  • Provide technical leadership, engineering guidance, and mentoring while promoting consistent standards and reusable patterns across the delivery team.
Qualifications
  • Bachelor’s degree in Computer Science, Data Engineering, Information Technology, Engineering, or a related discipline; equivalent relevant experience will also be considered.
  • Typically 7 or more years of relevant data engineering experience, including ownership of complex data onboarding and modelling deliveries.
  • Advanced hands-on Python and SQL skills, with strong software-engineering practices for modular, testable, supportable data solutions.
  • Strong practical experience with Databricks, Apache Spark, notebook-based development, Delta Lake or equivalent lakehouse patterns, and performance optimisation.
  • Demonstrated experience designing scalable ETL/ELT pipelines and layered bronze and silver data products using reusable engineering patterns.
  • Experience designing master data, dimensional, asset-centric, aggregation, and time-series models for analytics and reporting.
  • Strong understanding of data quality, metadata, lineage, reconciliation, observability, access controls, and production support.
  • Experience working with manufacturing and operational data, including batch, product, material, equipment, process, quality, and performance data.
  • Experience with manufacturing execution systems (MES), SAP, historians, laboratory or quality systems, and industrial analytics environments is highly desirable.
  • Knowledge of manufacturing KPIs and the underlying business rules for yield, cycle time, deviations, process performance, and trend-based analysis is highly desirable.
  • Experience with source control, CI/CD, automated testing, agile delivery, and regulated or validated data environments is preferred.
  • Strong analytical, problem-solving, stakeholder-management, and written and verbal communication skills, with the ability to translate operational requirements into robust technical solutions.
  • Proven ability to work across internal teams and external-site stakeholders, influence technical decisions, and deliver effectively with limited supervision.
  • Core technical capabilities: Python, SQL, Databricks, Apache Spark, lakehouse and Delta patterns, ETL/ELT pipeline engineering, data modelling, master data, data quality, metadata and lineage, Git-based source control, CI/CD, and cloud data-platform delivery.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

PlayStation • Ireland

On-site
EUR 90,000 - 130,000
Data Engineer - Python / Databricks
Data Engineer - Python / Databricks

Cpl Group • Dublin

On-site
EUR 110,000 - 160,000
Manufacturing AI & Data Analytics Engineer
Manufacturing AI & Data Analytics Engineer

Cognizant Life Sciences Manufacturing • Cork

On-site
EUR 70,000 - 110,000
Senior Data Engineer - Databricks Lakehouse & AI Pipelines
Senior Data Engineer - Databricks Lakehouse & AI Pipelines

Expleo Group • Dublin

On-site
EUR 90,000 - 140,000
Engineering Manager (Enterprise Data Engineering)
Engineering Manager (Enterprise Data Engineering)

PlayStation • Ireland

On-site
EUR 120,000 - 180,000
Senior Data Engineer - Databricks ETL & Master Data
Senior Data Engineer - Databricks ETL & Master Data

Intuition IT Solutions • Ireland

On-site
EUR 90,000 - 130,000
Senior Engineer (R-20003)
Senior Engineer (R-20003)

Dun & Bradstreet • Dublin

On-site
EUR 120,000 - 180,000
Data Analytics & AI Engineer,
Data Analytics & AI Engineer,

Cognizant Life Sciences Manufacturing • Cork

On-site
EUR 70,000 - 110,000
Industrial Data Engineer
Industrial Data Engineer

gea • Naas

On-site
EUR 70,000 - 110,000
Senior Data Engineer
Senior Data Engineer

G MASS Consulting • Dublin

On-site
EUR 90,000 - 130,000
Top locations