Senior Data Engineer — AWS Spark Pipelines for Healthcare

Source Meridian

United States

Remote

USD 140,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health benefits
Professional development opportunities
Learning environment

Job summary

Source Meridian seeks a Senior Data Engineer to design and operate an AWS-native data platform for processing healthcare claims data and tokenized identifiers. You will build Spark-based pipelines on S3, query via Athena, and optimize performance and cost.

The role emphasizes privacy, secure data handling, and collaboration with US-based stakeholders. You will contribute to dbt models when applicable, orchestrate workflows with Airflow, and work closely with cross-functional teams in a

Qualifications

  • 5+ years of professional experience in Data Engineering.
  • Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning.
  • Strong hands-on experience with the AWS data stack, including a mix of storage, processing, and orchestration services.

Responsibilities

  • Build and maintain Spark pipelines to process large-scale Parquet datasets on S3.
  • Implement tokenization workflows and dataset intersection logic.
  • Process healthcare claims datasets with accurate identity mapping and data integrity.
  • Orchestrate data pipelines using Airflow and AWS-native tools where appropriate.
  • Develop reliable ETL/ELT processes with retries, idempotency, monitoring, and reprocessing.

Skills

Apache Spark
SQL
Airflow
Leadership
Communication
Advanced English

Tools

AWS data stack
Amazon S3
Parquet
Athena
dbt
EMR

Job description

Source Meridian seeks a Senior Data Engineer to design and operate an AWS-native data platform for processing healthcare claims data and tokenized identifiers. You will build Spark-based pipelines on S3, query via Athena, and optimize performance and cost.

The role emphasizes privacy, secure data handling, and collaboration with US-based stakeholders. You will contribute to dbt models when applicable, orchestrate workflows with Airflow, and work closely with cross-functional teams in a

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

189. Senior Data Engineer
189. Senior Data Engineer

Source Meridian • United States

Remote
USD 140,000 - 180,000
Health benefits
Professional development opportunities
Learning environment
Senior Data Engineer: AWS ML & Data Pipelines
Senior Data Engineer: AWS ML & Data Pipelines

Paretohealth • Salt Lake City (UT)

Hybrid
USD 140,000 - 190,000
Medical benefits
Dental benefits
Vision benefits
+7
Senior Data Engineer — AWS Serverless Pipelines & ML
Senior Data Engineer — AWS Serverless Pipelines & ML

ParetoHealth • United States

Hybrid
USD 140,000 - 190,000
Medical, dental, vision benefits
Flexible PTO
401k contribution
+2
Senior Data Engineer | Azure Synapse, Spark & Pipelines
Senior Data Engineer | Azure Synapse, Spark & Pipelines

Health-eCommerce.com • United States

Remote
USD 130,000 - 165,000
Medical insurance
Dental insurance
Vision insurance
+5
Senior Data Pipeline Engineer - AWS, Spark & DataOps
Senior Data Pipeline Engineer - AWS, Spark & DataOps

VedaPointe, Inc. • United States

On-site
USD 120,000 - 170,000
Restaurant d'entreprise
Indemnités de stage/alternance
Senior Data Engineer - Remote, Healthcare Focus
Senior Data Engineer - Remote, Healthcare Focus

US Security & IT • United States

Remote
USD 95,000 - 120,000
Remote work
Professional development
Comprehensive benefits
+1
Senior Data Engineer - AWS & Databricks (Remote)
Senior Data Engineer - AWS & Databricks (Remote)

UST • Chicago (IL)

Remote
USD 92,000 - 138,000
401(k) matching
Medical, dental, and vision
Paid time off
+1
Senior Data Engineer – Healthcare Data Pipelines
Senior Data Engineer – Healthcare Data Pipelines

Health Gorilla • United States

On-site
USD 162,400 - 181,000
New hire stock option grant
401(k) plan with discretionary matching
Medical, dental, and vision insurance
+4
Data Engineer – Healthcare, AWS Pipelines & Serverless
Data Engineer – Healthcare, AWS Pipelines & Serverless

Compunnel Inc. • New York (NY)

On-site
USD 120,000 - 160,000
Senior Data Engineer: Scalable Cloud Pipelines & AWS
Senior Data Engineer: Scalable Cloud Pipelines & AWS

Medzown • United States

On-site
USD 90,000 - 120,000
Health insurance
Flexible working hours
Professional development opportunities