Senior PySpark Data Engineer - Healthcare ETL & Pipelines

Hexplora

Rancho Cucamonga (CA)

Hybrid

USD 120,000 - 170,000

Full time

32 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Infowave Systems is seeking a Senior Data Engineer (PySpark, ETL) to design, build, and maintain scalable data pipelines in the healthcare domain. The role blends development with operational oversight to ensure reliable performance.

You will work on migration and integration tasks across systems, leveraging PySpark, SSIS, and Cloudera Data Hub, while collaborating with data scientists and analysts to meet data requirements.

Qualifications

  • Strong experience in Data Engineering: designing, building, and maintaining ETL pipelines.
  • Proficiency with PySpark for large-scale processing.
  • Experience with SSIS and Cloudera Data Hub is a plus.

Responsibilities

  • Design, develop, and maintain scalable ETL pipelines using PySpark to process large datasets.
  • Collaborate with data scientists, analysts, and stakeholders to translate requirements into robust solutions.
  • Monitor, troubleshoot, and optimize data pipelines and infrastructure.
  • Manage data integration across healthcare systems, ensuring compliance with standards.
  • Leverage SSIS for ETL development across environments.
  • Integrate and transform data from multiple sources for quality and consistency.
  • Resolve data processing issues to minimize operational disruption.
  • Document best practices and workflows for pipeline efficiency.
  • Work with relational and non-relational databases to ensure smooth data flow and performance.

Skills

Data Engineering
PySpark
ETL pipelines
Relational databases
Data warehousing
Cloud platforms (AWS/GCP/Azure)
Healthcare data standards HL7/FHIR
Data pipeline monitoring

Tools

SSIS
Cloudera Data Hub

Job description

Infowave Systems is seeking a Senior Data Engineer (PySpark, ETL) to design, build, and maintain scalable data pipelines in the healthcare domain. The role blends development with operational oversight to ensure reliable performance.

You will work on migration and integration tasks across systems, leveraging PySpark, SSIS, and Cloudera Data Hub, while collaborating with data scientists and analysts to meet data requirements.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer with Pyspark
Senior Data Engineer with Pyspark

Hexplora • Rancho Cucamonga (CA)

Hybrid
USD 120,000 - 170,000
Senior Data Engineer – ETL/ELT & Pipelines
Senior Data Engineer – ETL/ELT & Pipelines

itD Tech • Clayton (GA)

On-site
USD 100,000 - 167,000
Medical benefits
401k plan
Paid holidays
Data Engineer
Data Engineer

The Value Maximizer • United States

On-site
USD 90,000 - 120,000
Data Engineer: ETL Pipelines, Python/SQL, Cloud
Data Engineer: ETL Pipelines, Python/SQL, Cloud

Definitive Healthcare Corp. • United States

Remote
USD 93,000 - 141,000
Medical, dental, vision
Unlimited PTO
401(k) match
Senior Databricks Architect - Remote PySpark Pipelines
Senior Databricks Architect - Remote PySpark Pipelines

Virtasant • Oregon

Hybrid
USD 96,000 - 165,000
Data Engineer — Build Scalable Pipelines with SQL/Python
Data Engineer — Build Scalable Pipelines with SQL/Python

Unlock Health • United States

Remote
USD 110,000 - 165,000
Competitive salary
Health, dental, vision benefits
Flexible PTO
+2
Data Engineer — Healthcare Cloud Data Pipelines
Data Engineer — Healthcare Cloud Data Pipelines

KNOWFINITY • Texas

On-site
USD 90,000 - 140,000
Senior Data Engineer: Scalable Pipelines & Data Quality
Senior Data Engineer: Scalable Pipelines & Data Quality

TechDigital Group • Burbank (CA)

On-site
USD 120,000 - 150,000
Senior Data Engineer: Data Pipelines & Analytics Architect
Senior Data Engineer: Data Pipelines & Analytics Architect

CVS Health • Alabama

Hybrid
USD 83,000 - 222,000
Senior Data Engineer - Scalable Pipelines & Spark Expert
Senior Data Engineer - Scalable Pipelines & Spark Expert

Ethereum Technologies LLC • Charlotte (NC)

On-site
USD 120,000 - 180,000