Senior Data Quality Engineer

Stanford Health Care; California (MO); On-site; USD 91,637 - 121,421; Full time

Job summary

Stanford Health Care is seeking a highly experienced Senior Data Engineer to advance data governance capabilities. In this role, you will lead the optimization of the data governance infrastructure, ensuring seamless management across platforms like Databricks. You will also design a robust data quality management platform aimed at establishing high standards for data.

Responsibilities include creating complex data pipelines, collaborating with stakeholders, and troubleshooting data quality issues.

Qualifications

• Seven or more years of experience in healthcare technology, analytics, or business intelligence.
• Experience with Cloud Data Lake technologies.
• Ability to work independently with minimal supervision.

Responsibilities

• Design and create complex data pipelines for analytics.
• Collaborate with stakeholders to implement data solutions.
• Ensure adherence to data governance standards.
• Troubleshoot and resolve data quality issues.

Skills

Advanced knowledge of relational database concepts

Advanced data modeling skills

Ability to develop solutions in cloud data platforms

Expert knowledge of SQL

Proficient at using data across multiple domains

Strong communication skills

Education

BS/BA degree in Information Technology or related field

Tools

Databricks

Azure

PySpark

GitHub

Job description

We are seeking a highly experienced and strategic Senior Data Engineer to lead the advancement of our enterprise data governance capabilities, serving as a cornerstone of our organization’s commitment to trusted, high-quality data. In this role, you will take ownership of optimizing and maturing our data governance infrastructure across key platforms, including Databricks Unity Catalog, to ensure seamless metadata management, data lineage, access control, and policy enforcement at enterprise scale. You will be instrumental in designing and implementing a robust data quality management platform—establishing the standards, frameworks, and automated monitoring pipelines that elevate confidence in data across every domain. Beyond quality, you will architect and govern a master data management platform that brings consistency, accuracy, and a single source of truth to our most critical data assets.

Overview

The Senior Enterprise Data Engineer is responsible for designing and creating complex pipelines and curated data structures/products for use by data analysts across the organization. This position also provides consultation and support of other data engineers in the design, development and implementation of data movement processes to populate the data structures designed.

What You Will Do

• Collaborate with leaders and users to create, test and implement complex stores, data pipelines, etc. based on understanding of business needs and requirements.
• Research, road map and maintain performance of SHC's standard data modeling, DevOps and development tools and processes.
• Explore and innovate with new technologies to create solutions, enhance development and/or operational efficiency, etc.
• Perform analysis, development and testing of complex data marts independently, support other data engineers in performing these tasks, and encourage use of the solutions for data‑driven decision making.
• Apply advanced knowledge of many data domains across SHC to produce high‑quality solutions.
• Build strong working relationships with users and team members, including Directors and above, and gain trust and respect of key users.
• Actively participate as a technical data steward in metadata, data quality and other data governance areas and activities, assisting in identification and resolution of data quality issues.
• Manage multiple complex activities, including tasks, dependencies and user/team expectations regarding scope and timeline of solution delivery.
• Provide project management or project leadership as appropriate to drive timelines and deliverables of projects across multiple departments/functions.
• Participate in and contribute to project working groups with team members, users, analysts, clinicians and SHC leadership.
• Lead teams to define design and development standards and conduct peer reviews of solution designs for compliance with such standards.
• Define analytics standards and best practices and support business data analysts in training and adoption of these standards.
• Participate in and actively contribute to SHC analytics community meetings.
• Tune performance of complex solutions.
• Troubleshoot and perform root‑cause analysis of incidents, establishing countermeasures to improve supported solutions.

Education Qualifications

• BS/BA degree in Information Technology, Information Systems, Business Management, Business Analytics, Business Administration or a directly related field from an accredited college or university.

Experience Qualifications

• Seven or more years of experience in reporting, analytics, business intelligence or healthcare technology; or three or more years of development experience in Cloud Data Lake technologies (e.g., PySpark notebooks/pipelines on Databricks) utilizing DevOps, CI/CD, orchestration processes.

Required Knowledge, Skills and Abilities

• Advanced knowledge of relational database concepts and design.
• Advanced data modeling skills, ability to translate business requirements into logical and physical database designs for moderate to large complex projects.
• Ability to develop solutions in cloud data platforms (e.g., Azure, Databricks) and technologies (e.g., PySpark, Notebooks, GitHub) to deploy production solutions in a secure and highly automated manner.
• Expert knowledge of SQL; proficient at relating and using data across multiple data domains.
• Expert knowledge and skills in SHC's standard development and design tools and general DevOps concepts and practices.
• Tune performance of moderately complex solutions.
• Troubleshoot and perform root‑cause analysis of incidents, establishing countermeasures to improve supported solutions.
• Work without direct supervision; provide regular updates to supervisor on pending tasks, pain points, and potential roadblocks.
• Demonstrate ability to complete complex projects.
• Deliver work of good quality with only rare problems or defects on moderate to complex solutions.
• Present moderately complex ideas and information to a variety of audiences, including senior managers and industry groups, using effective verbal, written and interpersonal communication skills.
• Help fulfill SHC's vision; understand how work supports the vision and propose better ways to achieve it.

Equal Opportunity Employer

Equal Opportunity Employer Stanford Health Care (SHC) strongly values diversity and is committed to equal opportunity and non‑discrimination in all of its policies and practices, including the area of employment. Accordingly, SHC does not discriminate against any person on the basis of race, color, sex, sexual orientation or gender identity and/or expression, religion, age, national or ethnic origin, political beliefs, marital status, medical condition, genetic information, veteran status, or disability, or the perception of any of the above. People of all genders, members of all racial and ethnic groups, people with disabilities, and veterans are encouraged to apply. Qualified applicants with criminal convictions will be considered after an individualized assessment of the conviction and the job requirements.

Base Pay Scale

Generally starting at $66.52 – $88.14 per hour. The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to, internal equity, experience, education, specialty and training. This pay scale is not a promise of a particular wage.