Lead Informatics Engineer - Cloud Data Lakehouse & Governance

UCSF; Oregon; Hybrid; USD 150,000 - 185,000; Full time

Job summary

UCSF Institute for Global Health Sciences is seeking an Informatics Specialist IV to lead engineering for CDPH’s cloud‑native Databricks Lakehouse environment, focusing on data governance, access, and scalable pipelines. The role involves collaboration with cross‑functional teams and senior staff to ensure reliable data infrastructure and high‑quality analytics for statewide health programs.

Ideal candidates will have strong SQL, Python, PySpark, and Databricks experience, plus a track record of

Qualifications

• Bachelor's degree in public health, health care information technology, computer science, or related area or equivalent experience.
• 5+ years of computer or data pipeline programming and database management or 5+ years in public health.
• Knowledge of data warehouse design, data integration, and data modeling.
• Proficiency in SQL, R, Python, and Apache Spark language APIs (e.g. PySpark, sparklyr).
• Experience with interoperability standards and health data systems.

Responsibilities

• Serve as technical leader for planning, developing, implementing, and analyzing complex public health informatics systems.
• Represent enterprise data needs in high-level design discussions for Databricks Lakehouse, data governance, and cloud architecture.
• Lead teams to build data pipelines, data models, data access frameworks, and data quality systems.
• Develop guidelines and provide technical assistance for data governance, access, interoperability, and metadata standards.

Skills

SQL

Python

PySpark

Databricks

Data governance

Data modeling

Public health informatics

Distributed computing

Leadership

Advanced analytics

Education

Bachelor's degree

Master's degree

Doctorate degree

Tools

Apache Spark APIs

Databricks

Job description

UCSF Institute for Global Health Sciences is seeking an Informatics Specialist IV to lead engineering for CDPH’s cloud‑native Databricks Lakehouse environment, focusing on data governance, access, and scalable pipelines. The role involves collaboration with cross‑functional teams and senior staff to ensure reliable data infrastructure and high‑quality analytics for statewide health programs.

Ideal candidates will have strong SQL, Python, PySpark, and Databricks experience, plus a track record of