Senior Data Engineer: Cloud Data Architect & Platform Lead

University of California - Los Angeles Health; Los Angeles (CA); On-site; USD 109,000 - 242,000; Full time

Job summary

University of California - Los Angeles Health is seeking an experienced Senior Data Engineer to design and build scalable data pipelines, develop trusted data products, and engineer data solutions across healthcare domains. The role emphasizes cloud capabilities with Azure/Databricks and modern engineering practices.

You will lead architectural discussions, create documentation, and mentor engineers while collaborating with leadership to shape the long-term data architecture roadmap.

Qualifications

• 5+ years of experience in data engineering or related roles.
• Strong programming experience with Python and production-quality code.
• Solid understanding of data warehousing, ETL/ELT, dimensional modeling, and large-scale data processing.
• Experience designing data pipelines ingesting data from multiple sources.
• Experience with modern data platforms (Databricks, Spark, Delta Lake, Snowflake, Fabric).
• Cloud platforms such as Azure, AWS or GCP; Azure experience valuable.
• Experience with orchestration tools like Azure Data Factory, Databricks Workflows, Airflow.
• Familiarity with CI/CD, testing, logging, monitoring, and release management.
• Experience with ML data workflows, ML-ready datasets, and MLflow/MLOps is a plus.

Responsibilities

• Design and build scalable data pipelines and platforms integrating diverse data sources.
• Develop trusted data products, curated datasets, and reusable data models.
• Engineer solutions across clinical, operational, financial, research, and admin healthcare data.
• Advance cloud-based data capabilities using Azure, Databricks, lakehouse architectures.
• Implement modern engineering practices including CI/CD, testing, orchestration, monitoring, and production support.
• Optimize data solutions for performance, scalability, security, and usability.
• Establish standards and reusable frameworks for data modeling, metadata, governance, and quality.
• Create data architecture documentation, lineage, dictionaries, and runbooks.
• Collaborate with tech and business teams to translate requirements into scalable data solutions.
• Lead design discussions and define operational approaches for initiatives.
• Mentor engineers through reviews, guidance, and knowledge sharing.

Skills

Python

Data modeling

Data pipelines

CI/CD

Collaboration

Education

Bachelor's degree in Computer Science or related field

Master's degree preferred

Tools

Databricks

Spark

Delta Lake

Snowflake

Microsoft Fabric

Azure

AWS

GCP

Azure Data Factory

Databricks Workflows

Airflow

Job description

University of California - Los Angeles Health is seeking an experienced Senior Data Engineer to design and build scalable data pipelines, develop trusted data products, and engineer data solutions across healthcare domains. The role emphasizes cloud capabilities with Azure/Databricks and modern engineering practices.

You will lead architectural discussions, create documentation, and mentor engineers while collaborating with leadership to shape the long-term data architecture roadmap.