Remote Senior Data Engineer - Databricks & Cloud

Geisinger Clinic; United States; Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

Remote work

Job summary

Geisinger Clinic’s Research Data Core seeks a Senior Data Engineer to design and maintain cloud-based data platforms and scalable pipelines. You will model clinical data in Databricks, build ETL processes, and modernize legacy pipelines for a research-focused environment.

The role emphasizes data quality, performance optimization, monitoring, and collaboration with multidisciplinary teams to support analytics and research applications.

Qualifications

• Proven experience with Databricks and cloud-based data engineering platforms.
• Strong experience with SQL and Python/PySpark for developing and optimizing data processing pipelines.
• Experience with Apache Spark and data modeling for large-scale datasets.

Responsibilities

• Designs and maintains PySpark and SQL data pipelines for transforming clinical data for research use.
• Develops and maintains data models and data warehouse schemas for large-scale datasets.
• Reviews, tests, debugs, and optimizes data ingestion and processing pipelines.
• Implements data quality checks and monitors pipeline performance and reliability.
• Collaborates with team to design solutions and document technical approaches.

Skills

Databricks

Python/PySpark

SQL

Cloud computing

Spark

Data pipelines

Education

Bachelor's degree in a related field

Tools

Databricks

AWS

SQL Server

PySpark

Job description

Geisinger Clinic’s Research Data Core seeks a Senior Data Engineer to design and maintain cloud-based data platforms and scalable pipelines. You will model clinical data in Databricks, build ETL processes, and modernize legacy pipelines for a research-focused environment.

The role emphasizes data quality, performance optimization, monitoring, and collaboration with multidisciplinary teams to support analytics and research applications.