189. Senior Data Engineer

Source Meridian

United States

Remote

USD 140,000 - 180,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Health benefits
Professional development opportunities
Learning environment

Job summary

Source Meridian seeks a Senior Data Engineer to design and operate an AWS-native data platform for processing healthcare claims data and tokenized identifiers. You will build Spark-based pipelines on S3, query via Athena, and optimize performance and cost.

The role emphasizes privacy, secure data handling, and collaboration with US-based stakeholders. You will contribute to dbt models when applicable, orchestrate workflows with Airflow, and work closely with cross-functional teams in a

Qualifications

  • 5+ years of professional experience in Data Engineering.
  • Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning.
  • Strong hands-on experience with the AWS data stack, including a mix of storage, processing, and orchestration services.

Responsibilities

  • Build and maintain Spark pipelines to process large-scale Parquet datasets on S3.
  • Implement tokenization workflows and dataset intersection logic.
  • Process healthcare claims datasets with accurate identity mapping and data integrity.
  • Orchestrate data pipelines using Airflow and AWS-native tools where appropriate.
  • Develop reliable ETL/ELT processes with retries, idempotency, monitoring, and reprocessing.

Skills

Apache Spark
SQL
Airflow
Leadership
Communication
Advanced English

Tools

AWS data stack
Amazon S3
Parquet
Athena
dbt
EMR

Job description

We’re looking for a Senior Data Engineer to join Source Meridian.
About Source Meridian

Source Meridian is a development software company that works to solve the industry’s most challenging problems in healthcare practices. We are laser focused on specific technologies in the healthcare and life science industries: Healthcare technology, artificial intelligence, and healthcare interoperability.

About the Role

We’re looking for a Senior Data Engineer to help build and operate an AWS-native data platform processing healthcare claims data and tokenized identifiers. You’ll design and implement Spark-based pipelines that transform, intersect, and enrich tokenized datasets stored primarily as Parquet on S3, queried via Athena and related AWS services. This environment intentionally avoids managed lakehouse platforms (e.g., no Databricks and no Snowflake)—you’ll be doing “real” data engineering directly on AWS.

What You’ll Do
  • Build and maintain Spark pipelines to process large-scale Parquet datasets on S3.

  • Implement tokenization workflows, including transit token → real token conversion and dataset intersection/join logic.

  • Process and deliver healthcare claims datasets for matched individuals, ensuring accurate identity mapping and data integrity.

  • Orchestrate data pipelines using Airflow and/or AWS-native orchestration tools when appropriate.

  • Develop reliable, testable, and observable ETL/ELT processes (retries, idempotency, monitoring, reprocessing).

  • Optimize performance and cost across Spark jobs, S3 partitioning/layout, and Athena query patterns.

  • Contribute to dbt models when applicable (transformations, documentation, data quality checks).

  • Collaborate with cross-functional stakeholders in a healthcare environment, with a strong focus on privacy and secure data handling.

Required Qualifications
  • 5+ years of professional experience in Data Engineering.

  • Strong experience with Apache Spark (PySpark or Scala), including joins, intersections, partitioning, and performance tuning.

  • Strong hands‑on experience with the AWS data stack , including:

  • Experience building and operating pipelines using Airflow (DAGs, scheduling, dependencies, backfills).

  • Excellent SQL skills and solid data modeling fundamentals.

  • Advanced English level: able to lead technical discussions, write clear documentation, and work directly with US-based stakeholders.

Nice to Have
  • Experience with dbt (core, tests, documentation, exposures).

  • Familiarity with healthcare data (claims data, eligibility, member‑level datasets).

  • Experience with tokenization, identity resolution, or privacy‑preserving data workflows.

  • Knowledge of AWS security concepts such as IAM, KMS, encryption, and secure data handling.

  • Experience running Spark on AWS (e.g., EMR) or Spark‑on‑containers architectures.

Tech Stack
  • AWS-native architecture

  • Amazon S3 + Parquet (core storage layer)

  • Amazon Athena (query engine)

  • Apache Spark (no Databricks)

  • Airflow (orchestration)

  • dbt (optional, as applicable)

Soft Skills
  • Strong and empathetic leadership.

  • Proven client‑facing experience.

  • Excellent communication skills.

  • Strong expectation management abilities.

  • Strategic mindset with a solution‑oriented approach and strong decision‑making skills.

What We Offer
  • Permanent contract
  • Learning and continuous growth environment
  • Benefits package focused on health and well‑being
  • Competitive salary based on experience

Apply only if you reside in Ecuador or Colombia

At Source Meridian, you’ll be part of a high-impact tech‑health company, building products that truly make a difference.

We’d love to meet you

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer — AWS Spark Pipelines for Healthcare
Senior Data Engineer — AWS Spark Pipelines for Healthcare

Source Meridian • United States

Remote
USD 140,000 - 180,000
Health benefits
Professional development opportunities
Learning environment
Senior Data Engineer
Senior Data Engineer

ParetoHealth • United States

Hybrid
USD 140,000 - 190,000
Medical, dental, vision benefits
Flexible PTO
401k contribution
+2
Senior Data Engineer (AWS, Python & SQL)
Senior Data Engineer (AWS, Python & SQL)

Devsu • United States

Remote
USD 120,000 - 180,000
Private health insurance
Flexible schedule
Remote-friendly culture
+1
Senior Data Engineer 2026 -COL
Senior Data Engineer 2026 -COL

Aimpoint Digital • United States

Remote
USD 140,000 - 190,000
Sr. Data Platform Engineer
Sr. Data Platform Engineer

Real Time Medical Systems • United States

Remote
USD 120,000 - 160,000
Competitive salary
Career development
Comprehensive health coverage
+2
Senior DataBricks Developer (Healthcare)
Senior DataBricks Developer (Healthcare)

Lumenalta • Dallas (TX)

Remote
USD 60,000 - 120,000
Flexible working hours
Health insurance
401(k) contribution
+3
Senior Data Engineer (Databricks on Azure)
Senior Data Engineer (Databricks on Azure)

Devsu • United States

Remote
USD 140,000 - 190,000
Stable long-term contract
Private health insurance
Remote-friendly culture
+3
Senior Data Engineer
Senior Data Engineer

VS Tech Solutions • Boise (ID)

Remote
USD 110,000 - 150,000
Comprehensive Healthcare: Medical, Dental and Vision
401(k) with company match
Fully remote opportunities available
+1
Data Engineer Sr
Data Engineer Sr

Sequoia Connect • United States

Remote
USD 120,000 - 160,000
Data Engineer I
Data Engineer I

NationsBenefits, LLC • Plantation (FL)

On-site
USD 60,000 - 85,000