Senior Public Health Data Engineer & Clinical Informatics

UCSF; Oregon; Hybrid; USD 125,000 - 165,000; Full time

Job summary

UCSF IGHS is seeking a Clinical Informatics Specialist III to join a data modernization effort, leveraging Databricks, Spark, and Delta Lake to design scalable pipelines and data marts that support public health operations and analytics. The role collaborates with data scientists, analysts, informaticians, and partners to deliver well-governed, interoperable data products.

The incumbent will translate clinical workflows into technical requirements, develop ingestion and curation logic, and

Qualifications

• Bachelor's degree in public health, health care information technology, computer science, or related area, and/or equivalent experience PLUS either 3 years of experience in computer or data pipeline programming and database management, OR 3 years in public health
• Experience with Databricks, Delta Lake, or cloud-based data lake architectures.
• Strong communication and collaboration skills across technical and non-technical stakeholders.

Responsibilities

• Design, develop, test, and maintain scalable data pipelines and enterprise data marts in Databricks using SQL, Python, and PySpark.
• Support development and maintenance of enhanced public health surveillance and operational data systems.
• Create standardized data models and curated datasets for multiple programs.
• Improve interoperability and align CDPH data systems with LHJs and partners.
• Ensure secure, automated ingestion, transformation, storage, and distribution of data.

Skills

SQL

Python

PySpark

R

Apache Spark

Databricks

Delta Lake

Cloud data pipelines

Education

Bachelor's degree in public health, health care IT, CS, or related

Master's degree in CS, informatics, public health, biostatistics (preferred)

Tools

Databricks

Delta Lake

Job description

UCSF IGHS is seeking a Clinical Informatics Specialist III to join a data modernization effort, leveraging Databricks, Spark, and Delta Lake to design scalable pipelines and data marts that support public health operations and analytics. The role collaborates with data scientists, analysts, informaticians, and partners to deliver well-governed, interoperable data products.

The incumbent will translate clinical workflows into technical requirements, develop ingestion and curation logic, and