Data Engineer, Senior

UPMC; Pittsburgh (Allegheny County); On-site; USD 140,000 - 190,000; Full time

Job summary

UPMC is seeking a Senior Data Engineer to develop end-to-end integration solutions for large, complex healthcare datasets. The role emphasizes test-driven development, SDLC standards, and Scrum practices, with strong collaboration across business, technical, and clinical teams.

In-office three days per week, you will lead multiple projects, ensure data accuracy and security, and produce robust monitoring and documentation.

Qualifications

• Bachelor’s degree in a field like mathematics, statistics, economics, finance, computer science, or another relevant field preferred.
• Typically has 7+ years of relevant experience or equivalent combination of education and experience.
• Technical writing skills
• Demonstrate proficiency in integration tools, ETL concepts, Java, Python, Spark, Kubernetes, OMOP CDM, Microsoft Fabric, AWS tools such as Lambda Functions, S3, AWS Glue
• Advanced analytical and problem-solving skills
• Ability to set and meet deadlines for complex projects
• Ability to work in high-pressure situations
• Reporting and data visualization skills
• Excellent attention to detail
• Proficiency in healthcare IT data or systems is required
• Experience with modern, scalable big-data architecture is preferred
• Experience with modern AI development workflows and accelerators are preferred
• Experience with clinical data formats and exchange protocols such as HL7, CDA, CCDA and FHIR are strongly preferred

Responsibilities

• Deliver complex end-to-end integration solutions following Data Engineering best practices.
• Execute solutions using Data Engineering design, development and delivery processes.
• Mentor team members and model integration policy adherence.
• Create infrastructure diagrams for project integrations.
• Build monitoring and alerting to integrate with various tools.
• Manage multiple user stories across scrum stages.
• Engage with vendors/clients to refine requirements and data sources.
• Collaborate across teams while representing Data Engineering as an SME.
• Write and maintain technical docs for integrations.
• Troubleshoot production issues and communicate status to stakeholders.
• Manage tasks and timelines; escalate risks and delays promptly.
• Communicate clearly and effectively in writing and speaking.
• Support team development and align work with business needs.

Skills

Java

Python

Spark

Kubernetes

OMOP CDM

Microsoft Fabric

AWS (Lambda, S3, Glue)

Data Modeling

Healthcare IT

Education

Bachelor’s degree in mathematics, statistics, economics, finance, CS or related field

Tools

ETL Tools

APIs

HL7/FHIR

DevOps tooling

Job description

Purpose

Senior Data Engineers develop custom end-to-end integration solutions for large data sets of diverse and complex healthcare data. Implementations include test driven development, SDLC standards and scrum principles. The team has set a high standard for quality. Deliveries require accuracy, performance stability, security, robust monitoring, alerting and pipeline uptime requirements. They will work closely with various business, technical and possibly clinical professionals daily. Additional responsibilities may include product support and ongoing data maintenance responsibilities. This position will be required to manage multiple projects and to prioritize work and have excellent written and verbal communication skills.

Senior Data Engineers develop custom end-to-end integration solutions for large data sets of diverse and complex healthcare data. Implementations include test driven development, SDLC standards and scrum principles. The team has set a high standard for quality. Deliveries require accuracy, performance stability, security, robust monitoring, alerting and pipeline uptime requirements. They will work closely with various business, technical and possibly clinical professionals daily. Additional responsibilities may include product support and ongoing data maintenance responsibilities. This position will be required to manage multiple projects and to prioritize work and have excellent written and verbal communication skills.

Please note that this position is in-office three days per week.

Must be legally authorized to work in the United States, without requiring, now or in the future, sponsorship for employment visa status. UPMC does not offer any type of sponsorship (H-1B, permanent residence, etc.) UPMC does not participate in STEM OPT.

Responsibilities

• Deliver complex end-to-end integration solutions that follow Data Engineering best practices and leverage test driven development and standard SDLC best practices.
• Execute solutions using the appropriate Data Engineering Design, Development and Delivery processes.
• Perform as a role model for other team members following integration policies and procedures.
• Create infrastructure diagrams for project specific integrations.
• Create appropriate monitoring, alerting and error messaging to integrate with various tools in accordance with Data Engineering standard practices.
• Work independently on complex projects managing multiple user stories and own and work on stories through each of the scrum stage gates effectively.
• Represent Data Engineering team in vendor and client discussions to refine requirements, discover data sources, drive design decisions, adhere to standards, and obtain necessary accesses to achieve accurate data representation.
• Work cooperatively and constructively with many teams and roles within the organizations, while independently representing the Data team as an SME.
• Write and maintain technical implementation and support documentation for integrations.
• Document, troubleshoot, and appropriately address production issues with the customer and effectively communicate with the team and other stakeholders.
• Manage tasks and timelines related to assigned work. Escalate risks and delays timely and effectively to the team Lead.
• Demonstrate the ability to create and deliver clear, concise, and effective written and oral communications.
• Complete projects, tasks, and initiatives by embracing a “team-first” approach. Work in collaboration with team and offer feedback, where appropriate, to support individual and group efforts. Show the ability to adjust and be flexible to change by adapting approaches when necessary.
• Responsible for continuous self-study, training, and/or seek opportunities to broaden scope and to stay up to date with industry and organizational trends. Seek feedback from team members for development and effectively incorporate feedback into work and behaviors.
• Build relationships across the One-Enterprises organization, developing awareness of big picture business drivers and customers’ needs to help align work and accelerate value delivery.
• Assist in the education and coaching of members both within the Data Engineering team and across the broader UPMC Enterprises team.
• Objectively assess and sign-off on teammates work according to team standards and processes.
• Bachelor’s degree in a field like mathematics, statistics, economics, finance, computer science, or another relevant field preferred.
• Typically has 7+ years of relevant experience or equivalent combination of education and experience.
• Technical writing skills
• Demonstrate proficiency in integration tools, ETL concepts, Java, Python, Spark, Kubernetes, OMOP CDM, Microsoft Fabric, AWS tools such as Lambda Functions, S3, AWS Glue
• Advanced analytical and problem-solving skills
• Ability to set and meet deadlines for complex projects
• Ability to work in high-pressure situations
• Reporting and data visualization skills
• Excellent attention to detail
• Proficiency in healthcare IT data or systems is required
• Experience with modern, scalable big-data architecture is preferred
• Experience with modern AI development workflows and accelerators are preferred
• Experience with clinical data formats and exchange protocols such as HL7, CDA, CCDA and FHIR are strongly preferred

Licensure, Certifications, and Clearances

UPMC is an Equal Opportunity Employer/Disability/Veteran