Senior Data Engineer, Enterprise Platforms & Pipelines

Stanford Health Care; California (MO); On-site; USD 140,000 - 210,000; Full time

Job summary

Stanford Health Care is seeking a Senior Enterprise Data Engineer to design and create complex data pipelines and curated data structures for use across the organization. You will drive data ingestion to the SHC Enterprise Data Platform and enable data products that improve patient outcomes and operations.

You will collaborate with analysts, clinicians and leadership, maintain standards for data modeling and DevOps, and explore new technologies to deliver scalable, automated solutions.

Qualifications

• BS/BA DEGREE IN INFORMATION TECHNOLOGY, INFORMATION SYSTEMS, BUSINESS MANAGEMENT, BUSINESS ANALYTICS, BUSINESS ADMINISTRATION OR A DIRECTLY RELATED FIELD FROM AN ACCREDITED COLLEGE OR UNIVERSITY REQUIRED.
• 7 (SEVEN) OR MORE YEARS' OF EXPERIENCE IN REPORTING, ANALYTICS, BUSINESS INTELLIGENCE OR HEALTHCARE TECHNOLOGY.
• OR 3 (THREE) OR MORE YEARS' DEVELOPMENT EXPERIENCE IN CLOUD DATALAKE TECHNOLOGIES (I.E., PYSPARK NOTEBOOKS/PIPELINES ON DATABRICKS) UTILIZING DEVOPS, CI/CD, ORCHESTRATION PROCESSES REQUIRED.
• Advanced knowledge of relational database concepts and design.
• Advanced data modeling skills, translate business requirements into designs.
• Develop solutions in cloud data platforms (Azure, DataBricks) with PySpark/Notebooks, GitHub.
• Expert SQL; relate data across multiple data domains.
• DevOps concepts/practices; CI/CD; performance tuning.
• Able to work without direct supervision; provide regular updates.
• Proven ability to complete complex projects.

Responsibilities

• Collaborates with leaders and users to create, test and implement complex stores, data pipelines and more.
• Researches, road maps and maintains performance of SHC's data modeling, DevOps and development tools.
• Explores new technologies to create solutions and improve efficiency.
• Performs analysis, development and testing of complex data marts and supports other data engineers.
• Builds strong relationships with users and team members including Directors and above.
• Participates in project work groups with analysts, clinicians and SHC leadership.
• Leads teams to define design and development standards and peer reviews.
• Defines analytics standards and supports training/adoption.
• Tune performance of complex solutions; troubleshoot and perform root cause analysis.

Skills

SQL

Data modeling

Cloud data platforms

PySpark / Databricks

DevOps / CI/CD

Notebooks

GitHub

Data governance

ETL / data pipelines

Stakeholder collaboration

Education

BS/BA degree in information technology, information systems, business analytics, business management or related field

Tools

Azure

Databricks

PySpark

Notebooks

GitHub

Job description

Stanford Health Care is seeking a Senior Enterprise Data Engineer to design and create complex data pipelines and curated data structures for use across the organization. You will drive data ingestion to the SHC Enterprise Data Platform and enable data products that improve patient outcomes and operations.

You will collaborate with analysts, clinicians and leadership, maintain standards for data modeling and DevOps, and explore new technologies to deliver scalable, automated solutions.