Senior Data Engineer, Databricks & Cloud Pipelines

Geisinger; Little Elm (TX); Remote; USD 140,000 - 180,000; Full time

Job summary

Geisinger Research Data Core is hiring a Senior Data Engineer to design and maintain cloud-based data pipelines for clinical and genomic data. You will model data, build scalable Databricks pipelines, and modernize legacy ETL processes in AWS environments.

You will contribute to data quality, performance optimization, monitoring, and support for research analytics across large datasets, collaborating with multidisciplinary teams and stakeholders.

Qualifications

• Proven Databricks experience in cloud data platforms.
• Strong SQL and Python/PySpark for pipelines.
• Experience with Apache Spark or similar.
• Experience with data modeling and data warehouse schemas.
• ETL development and modernization in cloud environments.

Responsibilities

• Designs, develops, and maintains PySpark and SQL data pipelines for clinical data.
• Develops and maintains data models within Databricks.
• Defines and optimizes data warehouse schemas for analytics.
• Ensures scalability and reliability of data pipelines and architecture.
• Implements data quality checks and monitors performance and costs.

Skills

PySpark

SQL

Python

Databricks

AWS

Spark

Data Modeling

Education

High School Diploma or GED

Bachelor's degree in Technology-related field

Tools

Databricks

AWS

SQL Server

Spark

Job description

Geisinger Research Data Core is hiring a Senior Data Engineer to design and maintain cloud-based data pipelines for clinical and genomic data. You will model data, build scalable Databricks pipelines, and modernize legacy ETL processes in AWS environments.

You will contribute to data quality, performance optimization, monitoring, and support for research analytics across large datasets, collaborating with multidisciplinary teams and stakeholders.