Senior Data Engineer: AWS Data Pipelines & MLOps

Paretohealth; Philadelphia (Philadelphia County); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Medical, dental, and vision benefits

Flexible PTO

401k company contribution

Professional development allowance

Transportation allowance and parking

Hybrid work environment

Job summary

ParetoHealth in Philadelphia seeks a Senior Data Engineer to design, build, and maintain serverless data pipelines and data models on AWS, ensuring analytics-ready data for AI teams and model training. You will own ingestions, transformations, and storage patterns using Lambda, Glue, Athena and S3, with collaboration across data science and analytics groups.

You will partner with Product, Underwriting, Analytics, and AI stakeholders to translate needs into robust data structures, SLAs, and data

Qualifications

• Experience with AWS data and serverless services (Lambda, Glue, Athena, S3).
• Strong Python and SQL, plus PySpark for distributed processing.
• Experience with MLOps, feature training data, CI/CD and monitoring.
• Knowledge of data modeling for AI workloads and schema evolution.
• Ability to design scalable, secure data pipelines for BI/AI initiatives.

Responsibilities

• Design, implement, and maintain serverless data pipelines on AWS.
• Build versioned data models and feature stores for AI/Analytics teams.
• Develop ETL/ELT workflows from internal apps and third parties.
• Collaborate with Product, Underwriting, Analytics and AI stakeholders.
• Implement data quality, monitoring, and governance controls.
• Optimize workloads for cost and performance; enforce CI/CD and IaC.
• Support model training, scoring, and production monitoring.

Skills

AWS data services

Python

SQL

PySpark

Data modeling

MLOps

Data pipelines

Communication

Security & governance

Education

Bachelor's degree in CS/Engineering/Math/Data Science

Master's degree preferred

Tools

AWS Lambda

AWS Glue

AWS Athena

AWS S3

AWS CDK

Kafka / Kinesis

Kedro

Job description

ParetoHealth in Philadelphia seeks a Senior Data Engineer to design, build, and maintain serverless data pipelines and data models on AWS, ensuring analytics-ready data for AI teams and model training. You will own ingestions, transformations, and storage patterns using Lambda, Glue, Athena and S3, with collaboration across data science and analytics groups.

You will partner with Product, Underwriting, Analytics, and AI stakeholders to translate needs into robust data structures, SLAs, and data