Lead Data Engineer - AI/ML

Aimlroles; Palo Alto (CA); On-site; USD 134,000 - 178,000; Full time

Job summary

Stanford Health Care seeks a Lead Data Engineer to join a team building AI-enabled health care solutions across patient care, research and administration. You will design, scale, and maintain compute frameworks, tooling, and model implementations used by the data science team.

You’ll collaborate with clinical and operations staff to deploy algorithms that improve outcomes, reports to the Data Science Director, and help ensure robust data processing software and infrastructure across SHC’s health

Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related, or equivalent working experience
• 5+ years experience in building data infrastructure for analytics teams, including ability to write code in SQL, R, or Python for processing large datasets in distributed cloud environments
• Experience with cloud deployment strategies and CI/CD.
• Experience building and working with data infrastructure in a SaaS environment.
• Experience overseeing, developing or implementing machine learning operations (MLOps) processes.
• Experience mentoring junior engineers and enforcing best practices around code quality.
• Knowledge of multiple programming languages, commitment to choosing languages based on project-specific requirements, and willingness to learn new programming languages as necessary.
• Knowledge of resource management and automation approaches such as workflow runners.
• Collaborative mentality and excitement for iterative design working closely with the Data Science team.

Responsibilities

• Build end-to-end data pipelines and infrastructure for ML models used by the Data Science team and others at SHC.
• Understand data processing and analysis pipeline requirements and design appropriate technical interfaces and training for researchers.
• Understand data flows among SHC applications and inform design of languages, tools, and platforms used in software projects.
• Troubleshoot and debug environment and infrastructure problems in production and non-production environments.
• Coordinate with SHC groups to ensure servers and system maintenance based on updates and security requirements.

Skills

SQL

Python

R

Cloud deployment

CI/CD

MLOps

Mentoring

Data infrastructure

Automation workflows

Team collaboration

Education

Bachelors/Masters in CS/Engineering

Job description

If you're ready to be part of our legacy of hope and innovation, we encourage you to take the first step and explore our current job openings. Your best is waiting to be discovered.

Day - 08 Hour (United States of America)

The Lead Data Engineer will be part of a team building Stanford Health Care's (SHC) solutions incorporating Artificial Intelligence including providing health care solutions in the areas of patient care, medical research and administrative services. This group is designed to bring Artificial Intelligence (AI) and other emerging machine learning (ML) based innovations in data science into healthcare and will partner closely with individuals across clinical specialties and operations areas to deploy algorithms that can lead to better patient outcomes. Reporting to the Data Science Director and working closely with Stanford Medicine's inaugural Chief Data Scientist, this role will be responsible for building, scaling and maintaining the compute frameworks, analysis tooling, model implementations and agentic solutions that form our core AI platform.

This is a Stanford Health Care job.

A Brief Overview

The Lead Data Engineer will be part of a team building Stanford Health Care's (SHC) solutions incorporating Artificial Intelligence including providing health care solutions in the areas of patient care, medical research and administrative services. This group is designed to bring Artificial Intelligence (AI), predictive algorithms and other emerging machine learning (ML) based innovations in data science into healthcare and will partner closely with individuals across clinical specialties and operations areas to deploy algorithms that can lead to better patient outcomes. Reporting to the Data Science Director and working closely with Stanford Medicine's inaugural Chief Data Scientist, this role will be responsible for maintaining compute frameworks, analysis tooling, and/or model implementations used or created by the team. The individual will design, implement, and support data processing software and infrastructure.

Locations

Stanford Health Care

What you will do

• Build end-to-end data pipelines and infrastructure for ML models used by the Data Science team and others at SHC.
• Understand the requirements of data processing and analysis pipelines and make appropriate technical design and interface decisions. Elucidating these requirements will require training, developing, and validating researcher-built or vendor provided machine learning algorithms on hospital data as well as working with other members of the data science team.
• Understand data flows among the SHC applications and use this knowledge to make recommendations and design decisions for languages, tools, and platforms used in software and data projects.
• Troubleshoot and debug environment and infrastructure problems found in production and non-production environments for projects by the Data Science Team.
• Work with other groups at SHC and the Technology and Digital Solutions (TDS) group to ensure servers and system maintenance based on updates, system requirements, data usage, and security requirements.

Education Qualifications

• Bachelor's or Master's degree in Computer Science, Engineering, or related, or equivalent working experience

Experience Qualifications

• 5+ years experience in building data infrastructure for analytics teams, including ability to write code in SQL, R, or Python for processing large datasets in distributed cloud environments

Required Knowledge, Skills and Abilities

• Experience with cloud deployment strategies and CI/CD.
• Experience building and working with data infrastructure in a SaaS environment.
• Experience overseeing, developing or implementing machine learning operations (MLOps) processes.
• Experience mentoring junior engineers and enforcing best practices around code quality.
• Knowledge of multiple programming languages, commitment to choosing languages based on project-specific requirements, and willingness to learn new programming languages as necessary.
• Knowledge of resource management and automation approaches such as workflow runners.
• Collaborative mentality and excitement for iterative design working closely with the Data Science team.

Physical Demands and Work Conditions

Blood Borne Pathogens

• Category II - Tasks that involve NO exposure to blood, body fluids or tissues, but employment may require performing unplanned Category I tasks

These principles apply to ALL employees:

SHC Commitment to Providing an Exceptional Patient & Family Experience

Stanford Health Care sets a high standard for delivering value and an exceptional experience for our patients and families. Candidates for employment and existing employees must adopt and execute C-I-CARE standards for all of patients, families and towards each other. C-I-CARE is the foundation of Stanford's patient-experience and represents a framework for patient-centered interactions. Simply put, we do what it takes to enable and empower patients and families to focus on health, healing and recovery.

• Know Me: Anticipate my needs and status to deliver effective care
• Show Me the Way: Guide and prompt my actions to arrive at better outcomes and better health
• Coordinate for Me: Own the complexity of my care through coordination

Equal Opportunity Employer Stanford Health Care (SHC) strongly values diversity and is committed to equal opportunity and non-discrimination in all of its policies and practices, including the area of employment. Accordingly, SHC does not discriminate against any person on the basis of race, color, sex, sexual orientation or gender identity and/or expression, religion, age, national or ethnic origin, political beliefs, marital status, medical condition, genetic information, veteran status, or disability, or the perception of any of the above. People of all genders, members of all racial and ethnic groups, people with disabilities, and veterans are encouraged to apply. Qualified applicants with criminal convictions will be considered after an individualized assessment of the conviction and the job requirements.

Base Pay Scale: Generally starting at $97.18 - $128.78 per hour

The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to, internal equity, experience, education, specialty and training. This pay scale is not a promise of a particular wage.