Senior Data Engineer — Remote Healthcare Data Pipelines

Dataroles; Northern (KY); Hybrid; USD 180,000 - 220,000; Full time

Benefits offered by this job

Work from anywhere (US)

Healthcare benefits

Unlimited PTO

Equity

401(k) with employer match

Job summary

Machinify is seeking a Senior Data Engineer to transform raw external data into trusted datasets powering payment and product decisions. You’ll build and scale production pipelines, onboard new customers, and ensure data accuracy, observability, and performance across healthcare data streams.

You will work with Product, Data Scientists, Engineers, SMEs, and Account Managers to deliver end-to-end data solutions and contribute to the evolution of the data platform in a fast-moving environment.

Qualifications

• 6+ years of experience as a Data Engineer (or equivalent).
• Strong expertise in Python, Spark SQL, and Airflow.
• Experience building production-grade data pipelines and processing large-scale datasets.
• Experience onboarding external customers and integrating diverse data sources.
• Familiarity with cloud platforms (AWS) and distributed computing concepts.
• Excellent communication skills and ability to collaborate across teams.

Responsibilities

• Design and implement robust production-grade data pipelines using Python, Spark SQL, and Airflow.
• Canonize raw healthcare data into internal models and schemas.
• Own end-to-end lifecycle of pipelines from ingestion to queryable datasets.
• Onboard new customers by integrating external data into internal pipelines and models.
• Build data quality checks, observability, and automated validation layers.
• Refactor and scale pipelines to meet growing data needs and performance targets.
• Collaborate with Data Analysts, Data Scientists, PMs, and SMEs to align with business needs.
• Monitor pipeline health and participate in on-call rotations to resolve issues.
• Develop streaming pipelines (Kafka, SQS) for near-real-time data when needed.
• Contribute to best practices in data modeling and pipeline development.

Skills

Python

Spark SQL

Airflow

Data pipelines

Cloud (AWS)

Healthcare data

Onboarding customers

Cross-functional collaboration

Data quality & observability

Kafka

SQS

Tools

Kafka

SQS

Job description

Machinify is seeking a Senior Data Engineer to transform raw external data into trusted datasets powering payment and product decisions. You’ll build and scale production pipelines, onboard new customers, and ensure data accuracy, observability, and performance across healthcare data streams.

You will work with Product, Data Scientists, Engineers, SMEs, and Account Managers to deliver end-to-end data solutions and contribute to the evolution of the data platform in a fast-moving environment.