Sr. Enterprise AI Platform Engineer

LE0010 Stanford Health Care; Palo Alto (CA); On-site; USD 140,000 - 185,000; Full time

Job summary

Stanford Health Care is seeking a Senior Enterprise Data Engineer to design complex data pipelines and curated data structures for use by data analysts. The role supports SHC’s enterprise data platform and collaborates with data scientists on DevOps, SecOps and FinOps processes.

You will lead in building automated IaC and monitoring capabilities, ensuring data quality and governance across multiple data domains, while guiding data engineers in design and standards adoption.

Qualifications

• BS/BA degree in information technology, information systems, business analytics, management or related field is required.
• 7+ years in reporting, analytics, BI, or healthcare tech OR 3+ years in cloud data lake technologies (Databricks) with DevOps/CI/CD.
• Advanced data modeling and relational database design knowledge.
• Experience deploying production AI/ML data solutions in cloud platforms (Azure, DataBricks).

Responsibilities

• Design and create complex data stores and pipelines for data analysts across SHC.
• Lead data movement processes to populate designed data structures across SHC.
• Tune performance and ensure data governance across data platforms and pipelines.
• Collaborate with data scientists on DevOps, SecOps and FinOps processes.

Skills

Relational database concepts

Data modeling

Cloud data platforms

PySpark

SQL

GitHub

DevOps concepts

Notebooks

Education

BS/BA degree in IT or related field

Tools

Azure

DataBricks

PySpark

Notebooks

GitHub

CI/CD

Job description

Day - 08 Hour (United States of America) This is a Stanford Health Care job.

This role will focus on the design, development, and enhancement of processes, tools and infrastructure used to support SHC's Data Scientists as they create and deploy AI/ML solutions utilizing the Enterprise Data Platform. This requires close coordination with Data Scientists on DevOps, SecOps, and FinOps processes, infrastructure planning and automated Infrastructure as Code (IaC) processes, and creation of monitoring capabilities to assess the accuracy, validity, and usefulness of AI/ML solutions over time.

A Brief Overview

The Senior Enterprise Data Engineer is responsible for designing and creating complex pipelines and curated data structures/products for use by data analysts across the organization. This position is also responsible consultation and support of other data engineers in the design, development and implementation of data movement processes to populate the data structures designed. This position exists to provide data solutions for broad and consistent use across the SHC enterprise.

Locations

Stanford Health Care

What you will do

With advanced technical knowledge and skills, collaborates with leaders and users to create, test and implement complex stores , data pipelines, etc. based on understanding of business needs and requirements. Responsible for the research, road mapping and maintaining performance of SHC's standard data modeling, DevOps and development tools and processes. Explore and innovate with new technologies to create solutions, enhance development and/or operational efficiency, etc. Without supervision, performs analysis, development, and testing of complex data marts, and support other data engineers in performing these tasks, and encourages use of the solutions for data-driven decision making. Possesses an advanced understanding of many data domains across SHC and uses it to produce high quality solutions. Build strong working relationships with users and team members, including Directors and above. Gains trust and respect of key users. Understands advanced data governance principles and practices and actively participates as a technical data steward in metadata, data quality, and other data governance areas and activities. Assists in identification and resolution of data quality issues. Manage multiple complex activities. Manage tasks, dependencies, and user/team expectations regarding scope and timeline of solution delivery. Provides project management / project leadership as appropriate to drive timelines and deliverables of projects across multiple departments/functions Participates in and contributes to project working groups with team members, users, analysts, clinicians, and SHC leadership. Leads teams to define design and development standards and conduct peer reviews of solution designs for compliance with such standards. Defines analytics standards and best practices and support business data analysts in training and adoption of these standards. Participates in and actively contributes to SHC analytics community meetings Tune performance of complex solutions. Troubleshoots and performs root cause analysis of incidents and establishes countermeasures to improve supported solutions.

Education Qualifications

BS/BA DEGREE IN INFORMATION TECHNOLOGY, INFORMATION SYSTEMS, BUSINESS MANAGEMENT, BUSINESS ANALYTICS, BUSINESS ADMINISTRATION OR A DIRECTLY RELATED FIELD FROM AN ACCREDITED COLLEGE OR UNIVERSITY REQUIRED.

Experience Qualifications

• 7 (SEVEN) OR MORE YEARS’ OF EXPERIENCE IN REPORTING, ANALYTICS, BUSINESS INTELLIGENCE OR HEALTHCARE TECHNOLOGY.
• OR 3 (THREE) OR MORE YEARS’ DEVELOPMENT EXPERIENCE IN CLOUD DATALAKE TECHNOLOGIES (I.E., PYSPARK NOTEBOOKS/PIPELINES ON DATABRICKS) UTILIZING DEVOPS, CI/CD, ORCHESTRATION PROCESSES REQUIRED.

Required Knowledge, Skills and Abilities

• Advanced knowledge of relational database concepts and design
• Advanced data modeling skills, ability to translate business requirements into logical and physical database designs for moderate to large complex projects.
• Ability to develop solutions in cloud data platforms (i.e., Azure, DataBricks, etc.) and technologies (i.e., PySpark, Notebooks, GitHub, etc.) to deploy production solutions in a secure and highly automated manner.
• Expert knowledge of SQL.
• Proficient with ability to relate and use data across multiple data domains.
• Expert knowledge and skills in SHC's standard development and design tools and general DevOps concepts/practices.
• Tune performance of moderately complex solutions.
• Troubleshoots and performs root cause analysis of incidents and establishes countermeasures to improve supported solutions.
• Able to work without direct supervision.
• Provides regular updates to supervisor on pending tasks, pain points, and potential roadblocks.
• Demonstrated ability for completing complex projects.
• Work is of good quality with only rare problems or defects with moderate to complex solutions.
• Can successfully present moderately complex ideas and information to a variety of audiences, including senior managers and industry groups.
• Effective verbal, written, and interpersonal communication skills.
• Helps fulfill SHC's vision.
• Understands how their work supports the vision and proposes better ways to achieve the vision.

These principles apply to ALL employees: SHC Commitment to Providing an Exceptional Patient & Family Experience

Stanford Health Care sets a high standard for delivering value and an exceptional experience for our patients and families. Candidates for employment and existing employees must adopt and execute C-I-CARE standards for all of patients, families and towards each other. C-I-CARE is the foundation of Stanford’s patient-experience and represents a framework for patient-centered interactions. Simply put, we do what it takes to enable and empower patients and families to focus on health, healing and recovery. You will do this by executing against our three experience pillars, from the patient and family’s perspective: Know Me: Anticipate my needs and status to deliver effective care Show Me the Way: Guide and prompt my actions to arrive at better outcomes and better health Coordinate for Me: Own the complexity of my care through coordination

Equal Opportunity Employer

Stanford Health Care (SHC) strongly values diversity and is committed to equal opportunity and non-discrimination in all of its policies and practices, including the area of employment. Accordingly, SHC does not discriminate against any person on the basis of race, color, sex, sexual orientation or gender identity and/or expression, religion, age, national or ethnic origin, political beliefs, marital status, medical condition, genetic information, veteran status, or disability, or the perception of any of the above. People of all genders, members of all racial and ethnic groups, people with disabilities, and veterans are encouraged to apply. Qualified applicants with criminal convictions will be considered after an individualized assessment of the conviction and the job requirements.

Base Pay Scale

• Base Pay Scale: Generally starting at $66.52 - $88.14 per hour
• The salary of the finalist selected for this role will be set based on a variety of factors, including but not limited to, internal equity, experience, education, specialty and training.
• This pay scale is not a promise of a particular wage.

At Stanford Health Care, we seek to provide patients with the very best in diagnosis and treatment, with outstanding quality, compassion and coordination. With an unmatched track record of scientific discovery, technological innovation and translational medicine, Stanford Medicine physicians are pioneering leading edge therapies today that will change the way health care is delivered tomorrow. As part of our spirit of discovery, we also leverage our deep relationships with luminary Silicon Valley companies to develop new ways to deliver preeminent patient care. Learn about our awards and significant events.