Lead Data Engineer

Brasseler USA Inc.; Dublin; Hybrid; EUR 120,000 - 160,000; Full time

Job summary

Henry Schein is seeking a highly technical Senior Data Engineer to design, build, and optimize scalable data pipelines and platforms. This hands-on role will lead a small offshore data engineering team to deliver high-quality, performant data solutions.

Responsibilities include designing batch and real-time pipelines with Databricks and Spark, building lakehouse architectures, and ensuring data quality, observability, and collaboration with API, Analytics, and Platform teams.

Qualifications

• 8-12 years of experience in data engineering.
• Proven experience leading or coordinating offshore or distributed engineering teams.
• Deep hands-on expertise with Databricks, Spark, and distributed data processing.
• Advanced proficiency in Python and/or Scala, plus strong SQL skills.
• Strong experience with performance tuning and optimization of large-scale data pipelines.
• Experience with cloud data platforms (Azure strongly preferred).
• Solid understanding of data modeling, streaming architectures, and data lifecycle management.
• Experience implementing data quality, lineage, and governance controls.

Responsibilities

• Design, develop, and optimize complex batch and real-time data pipelines using Databricks, Spark, and related technologies.
• Build and maintain scalable lakehouse architectures and high-performance data models to support business driven outcomes
• Provide technical leadership and day-to-day coordination for a small offshore data engineering team.
• Define tasks, review deliverables, and ensure adherence to engineering standards and timelines.
• Lead the implementation of advanced ETL/ELT frameworks and reusable data engineering patterns.
• Solve complex data challenges including performance tuning, data skew, partitioning, and large-scale processing.
• Implement robust data quality, validation, and observability frameworks.
• Collaborate closely with API, Analytics, and Platform teams to deliver reliable, production-grade data assets.
• Drive best practices in coding standards, testing, and CI/CD for data pipelines.
• Troubleshoot and resolve production issues, ensuring high availability and reliability.
• Act as the primary liaison between onshore stakeholders and offshore delivery teams.

Skills

Databricks

Spark

Python

Scala

SQL

Azure

Data modeling

Data governance

Offshore leadership

Tools

Kafka/Confluent

Snowflake

Job description

Job Description Role Summary

We are seeking a highly technical Senior Data Engineer to design, build, and optimize scalable data pipelines and platforms. This role is primarily hands-on, with responsibility for leading and coordinating a small offshore data engineering team to deliver high-quality, performant data solutions.

Key Responsibilities

• Design, develop, and optimize complex batch and real-time data pipelines using Databricks, Spark, and related technologies.
• Build and maintain scalable lakehouse architectures and high-performance data models to support business driven outcomes
• Provide technical leadership and day-to-day coordination for a small offshore data engineering team.
• Define tasks, review deliverables, and ensure adherence to engineering standards and timelines.
• Lead the implementation of advanced ETL/ELT frameworks and reusable data engineering patterns.
• Solve complex data challenges including performance tuning, data skew, partitioning, and large-scale processing.
• Implement robust data quality, validation, and observability frameworks.
• Collaborate closely with API, Analytics, and Platform teams to deliver reliable, production-grade data assets.
• Drive best practices in coding standards, testing, and CI/CD for data pipelines.
• Troubleshoot and resolve production issues, ensuring high availability and reliability.
• Act as the primary liaison between onshore stakeholders and offshore delivery teams.

Required Qualifications

• 8-12 years of experience in data engineering.
• Proven experience leading or coordinating offshore or distributed engineering teams.
• Deep hands-on expertise with Databricks, Spark, and distributed data processing.
• Advanced proficiency in Python and/or Scala, plus strong SQL skills.
• Strong experience with performance tuning and optimization of large-scale data pipelines.
• Experience with cloud data platforms (Azure strongly preferred).
• Solid understanding of data modeling, streaming architectures, and data lifecycle management.
• Experience implementing data quality, lineage, and governance controls.

Preferred Experience

• Experience with Kafka/Confluent and real-time streaming pipelines.
• Exposure to Snowflake or similar cloud data warehouses.
• Experience supporting AI/ML pipelines or feature engineering workflows.
• Background in regulated industries (e.g., healthcare).

Henry Schein is committed to the principle of equal opportunities in employment in all spheres of its operation.

Henry Schein UK Holdings strives to operate a policy of equal opportunity and not discriminate against any person gender, race, colour, nationality, ethnic or national origin, religion, sexual orientation, marital status, disability, age or any other characteristic protected by law.

Over 90 years ago Henry Schein borrowed $500 to start a corner pharmacy in Queens, New York, nearly 30 miles from Melville, New York, where our corporate headquarters resides today. In the depths of the Great Depression, Henry and his wife Esther made a bold bet on their future all while living their values of helping health happen and caring for their team and the community they served. Their belief paid off far beyond what Henry and Esther might have dared to imagine in 1932. Henry Schein is now a Fortune 500 Company powered by a network of people and technology to be the world’s leading provider of health care products, services and solutions to office-based dental and medical practitioners. Since our founding we have stayed true to Henry and Esther’s values which has allowed us to evolve, expand, and grow our Company. Now serving more than 1 million customers in 33 countries and territories, the Company's network of trusted advisors provides more than 1 million customers globally with more than 300 valued solutions that help improve operational success and clinical outcomes.

We invite you to join approximately 25,000 Team Schein Members, who are critical to our success and are at the core of our Team Schein Values as our founders would have wanted. We live those values by ensuring that our culture focuses on the wellness of our team, which we accomplish by providing a safe space for individuals to develop and contribute authentically, with opportunities to give back to society and the communities where we live and work. No matter the role you are seeking, we encourage you to come be a part of a team that makes the world a healthier place.

Henry Schein embraces diversity and is committed to providing equal opportunity to employees and applicants.

Work Arrangements

• Work From Home: Work is performed directly from the TSM's home office.
• Hybrid: Time is scheduled between working from a TSM home office and at a company facility, as required.
• Onsite: Work is performed exclusively at a company facility.
• Field: Position requires traveling to different locations within a specific geographic territory, as assigned.