Cloud Data Engineer, Clinical Informatics & Public Health

UCSF Health, AG; California; On-site; USD 120,000 - 160,000; Full time

Job summary

UCSF Institute for Global Health Sciences seeks a Clinical Informatics Specialist III to advance CDPH’s enterprise data modernization. You will design, build, and maintain scalable data pipelines and data marts in a cloud-native Databricks environment, enabling analytics and strategic decision-making for public health programs.

You will collaborate with data scientists, analysts, informaticians, and program partners to deliver well-governed, interoperable data products and to improve

Qualifications

• Bachelor’s degree or equivalent with 3 years of data pipeline programming or public health experience.
• Experience with SQL, R, Python and Apache Spark APIs (e.g., PySpark).
• Experience with Databricks, Delta Lake, or cloud-based data lake architectures.
• Knowledge of health informatics, data governance, and public health data systems.
• Strong communication skills to convey complex information effectively.

Responsibilities

• Design, develop, test, and maintain scalable data pipelines and data marts in Databricks using SQL, Python, and PySpark.
• Support development of enhanced public health surveillance and operational data systems.
• Create standardized data models and curated datasets for multiple use cases.
• Improve interoperability across CDPH data systems and integrate with LHJs and partners.
• Ensure secure, automated ingestion, transformation, storage, and distribution of data.
• Participate in data architecture, modeling, and quality assurance activities.
• Contribute to tools, frameworks, and monitoring for reliable data pipelines.
• Prototype new engineering approaches to meet evolving stakeholder needs and improve scalability.

Skills

Analytical thinking

Communication

SQL

Python

R

Apache Spark

Public health informatics

Problem solving

Education

Bachelor's degree in public health, health care information technology, computer science, or related area

Master’s degree in computer science, informatics, public health, biostatistics, epidemiology (preferred)

Tools

Databricks

Delta Lake

PySpark

Job description

UCSF Institute for Global Health Sciences seeks a Clinical Informatics Specialist III to advance CDPH’s enterprise data modernization. You will design, build, and maintain scalable data pipelines and data marts in a cloud-native Databricks environment, enabling analytics and strategic decision-making for public health programs.

You will collaborate with data scientists, analysts, informaticians, and program partners to deliver well-governed, interoperable data products and to improve