Senior Data Engineer, AI Value Realization

Penn Medicine; Philadelphia (Philadelphia County); Remote; USD 120,000 - 165,000; Full time

Job summary

Penn Medicine is seeking a Senior Data Engineer to measure real-world impact of AI-enabled clinical technologies. You will design scalable data products, analytical datasets, and measurement frameworks to evaluate outcomes in provider workflow and patient care.

Work with clinical, operational, analytics, and informatics teams to build data pipelines, ETL/ELT processes, and cloud-based solutions using Azure, Databricks, and Azure SQL Database.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, or related field is required.
• 3+ years of experience in data engineering, database management, or related roles, with significant experience managing work is required.
• Proven track record of leading and executing moderately complex projects with minimal oversight is required.

Responsibilities

• Data Integration and Processing: Design scalable data pipelines ingesting data from EHRs and clinical systems.
• ETL/ELT Development: Build ETL/ELT processes using Azure and Databricks to ensure data quality.
• Cloud Infrastructure: Implement cloud-based data platforms leveraging AWS, Azure, and Databricks.
• Data Governance and Security: Enforce HIPAA compliance and data privacy.
• Performance Monitoring: Monitor pipelines and optimize for reliability.

Skills

ETL/ELT

Cloud platforms

Data pipelines

SQL

HIPAA compliant

Education

Bachelor's degree

Epic Clarity Data Model (6 months)

Tools

Azure

Databricks

Azure SQL Database

Job description

Description

Penn Medicine is dedicated to our tripartite mission of providing the highest level of care to patients, conducting innovative research, and educating future leaders in the field of medicine. Working for this leading academic medical center means collaboration with top clinical, technical and business professionals across all disciplines.

Today at Penn Medicine, someone will make a breakthrough. Someone will heal a heart, deliver hopeful news, and give comfort and reassurance. Our employees shape our future each day. Are you living your life's work?

• Entity: Corporate Services

• Department: PennDNA Data Management and Ops

• Location: Remote based out of 3535 Market St

• Hours: 8hr Days

Summary :

This Senior Data Engineer role will be a key contributor to Penn Medicine's efforts to measure and demonstrate the real-world impact of AI-enabled clinical technologies, including ambient listening and other provider workflow interventions. The individual will design and develop scalable data products, analytical datasets, and measurement frameworks that enable the organization to evaluate how these technologies influence clinical, operational, provider, and patient outcomes.

Working closely with clinical, operational, analytics, and informatics stakeholders, this role will build data engineering solutions that support the development of metrics and models focused on outcomes such as provider satisfaction, reduction in after-hours documentation ("pajama time"), documentation and coding quality, patient satisfaction, care delivery efficiency, and broader health outcomes. The successful candidate will help establish trusted, scalable data foundations that enable rigorous evaluation of AI interventions and support data-driven decision making across the health system.

Responsibilities:

• Data Integration and Processing: Design and architect scalable and reliable data pipelines to ingest, process, and transform large volumes of healthcare data from diverse sources, including electronic health records (EHR), clinical systems, research databases, and external data feeds.

• ETL/ELT Development: Build and optimize ETL/ELT processes and work within Cloud technology such as Azure and Databricks to ensure efficient data extraction, transformation, and loading while maintaining data quality, consistency, and integrity. Collaborate with a variety of stakeholders across the organization to understand data requirements and translate them into effective ETL/ELT solutions that meet organizational goals.

• Cloud Infrastructure and Technologies: Implement and maintain cloud-based data platforms and services, leveraging technologies such as AWS, Azure, or Databricks. Design and deploy data solutions using cloud-native services, such as Azure SQL Database, to support advanced analytics, machine learning, and data visualization initiatives.

• Data Governance and Security: Enforce data governance policies, standards, and procedures to ensure compliance with regulatory requirements (e.g., HIPAA, GDPR) and organizational data security policies. Participate in implementation of metric standards, access controls, encryption, and auditing mechanisms to protect sensitive healthcare data and ensure data privacy and confidentiality.

• Performance Monitoring: Monitor performance of data pipelines ETL/ELT processes, databases and data warehouses, troubleshoot issues, and implement optimizations to improve efficiency, reliability, and scalability.

• Collaboration: Collaborate with cross-functional teams to define project requirements and develop solutions that meet organizational needs. Provide technical leadership and mentorship to junior data engineers and associate data engineers, fostering a culture of continuous learning and innovation within the data engineering team.

• Continuous Improvement: Demonstrate a commitment to continuous learning and professional development. Stay current with industry trends, best practices, and emerging technologies in data engineering, ELT/ETL processes and data transformation. Look for opportunities to optimize the team’sprocesses and workflows.

• Performs duties in accordance with Penn Medicine and entity values, policies, and procedures.

• Other duties as assigned to support the unit, department, entity, and health system organization.

Credentials:

• Epic Clarity Data Model (must be completed within 6 months of start date

Education or Equivalent Experience:

• Bachelor's degree in Computer Science, Information Systems, or related field is required.

• 3+ years of experience in data engineering, database management, or related roles, with significant experience managing work is required.

• Proven track record of leading and executing moderately complex projects with minimal oversight is required.

We believe that the best care for our patients starts with the best care for our employees. Our employee benefits programs help our employees get healthy and stay healthy. We offer a comprehensive compensation and benefits program that includes one of the finest prepaid tuition assistance programs in the region. Penn Medicine employees are actively engaged and committed to our mission. Together we will continue to make medical advances that help people live longer, healthier lives.

Live Your Life's Work

We are an Equal Opportunity employer. Candidates are considered for employment without regard to race, ethnicity, color, sex, sexual orientation, gender identity, religion, national origin, ancestry, age, disability, marital status, familial status, genetic information, domestic or sexual violence victim status, citizenship status, military status, status as a protected veteran or any other status protected by applicable law.

REQNUMBER: 325675