Senior Data Engineer — AWS Serverless Pipelines & ML

ParetoHealth; United States; Hybrid; USD 140,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, vision benefits

Flexible PTO

401k contribution

Professional development allowance

Transportation allowance & parking

Job summary

ParetoHealth is hiring a Senior Data Engineer to design and maintain serverless data pipelines on AWS, enabling analytics and AI use cases for healthcare data. You will own ingestions, transformations, and storage patterns with Lambda, Glue, Athena, and S3, and partner with Data Science for MLOps and model workflows.

You will build scalable data models, feature stores, and backfills, while enforcing data quality, schema evolution, and security.

Qualifications

• Strong experience with AWS data and serverless services (Lambda, Glue, Athena, S3, Step Functions).
• Advanced Python and SQL, with PySpark preferred; TypeScript for CDK.
• Experience with MLOps, including feature/train datasets and CI/CD in AI contexts.
• Data modeling for AI workloads; schema evolution and partitioning.
• Experience designing large-scale data pipelines and event streaming (Kafka).
• Data quality, governance, and security for sensitive data.

Responsibilities

• Design, implement, and maintain scalable serverless data pipelines on AWS.
• Build versioned data models and feature stores with reproducible backfills.
• Develop ETL/ELT workflows for ingestion from internal and external sources.
• Collaborate with Product, Underwriting, Analytics, and AI stakeholders on data needs.
• Implement data quality controls, monitoring, and lineage tracking.
• Optimize serverless workloads and storage formats for cost and performance.
• Contribute to infrastructure as code (AWS CDK) and CI/CD for data pipelines.
• Work with AI teams on feature stores, scoring, and model deployment.
• Operate streaming data pipelines for near-real-time scoring and decisioning.

Skills

AWS data services

Python

SQL

PySpark

TypeScript (CDK)

MLOps

Data modeling

ETL/ELT design

Data quality & governance

CI/CD

Education

Bachelor's degree in CS/Engineering/Data Science

Master's preferred

Tools

AWS CDK

Kafka

Hadoop/Parquet/Iceberg

S3

Glue

Athena

Job description

ParetoHealth is hiring a Senior Data Engineer to design and maintain serverless data pipelines on AWS, enabling analytics and AI use cases for healthcare data. You will own ingestions, transformations, and storage patterns with Lambda, Glue, Athena, and S3, and partner with Data Science for MLOps and model workflows.

You will build scalable data models, feature stores, and backfills, while enforcing data quality, schema evolution, and security.