DataOps Engineer: Automate Pipelines & Observability

ValueMomentum, Inc.; Erie (Erie County); On-site; USD 120,000 - 180,000; Full time

Job summary

ValueMomentum is seeking a senior data engineer to design and optimize data pipelines in our Tech Center, focusing on data orchestration, observability, and scalable architectures.

You will work with AWS services, Medallion architecture, and DataOps practices to deliver reliable data products for insurance clients.

The role requires strong Python, PySpark, SQL skills and a proactive approach to cost management and performance tuning.

Qualifications

• Hands-on experience with AWS and data engineering in a modern DataOps environment.
• Deep knowledge of Medallion architecture and data platforms.
• Strong SQL, Python, and PySpark proficiency.
• Experience with XML data handling and data quality.

Skills

DataOps

Data pipelines

ETL/ELT

CI/CD

Observability

SLA/SLOs

Root Cause Analysis

Release lifecycle

Automated testing

AWS

Medallion architecture

Terraform

CloudFormation

Python

PySpark

SQL

XML handling

FinOps

IAM

Cost optimization

Job description

ValueMomentum is seeking a senior data engineer to design and optimize data pipelines in our Tech Center, focusing on data orchestration, observability, and scalable architectures.

You will work with AWS services, Medallion architecture, and DataOps practices to deliver reliable data products for insurance clients.

The role requires strong Python, PySpark, SQL skills and a proactive approach to cost management and performance tuning.