DataOps Engineer

ValueMomentum, Inc.; Erie (Erie County); On-site; USD 120,000 - 180,000; Full time

Job summary

ValueMomentum is seeking a senior data engineer to design and optimize data pipelines in our Tech Center, focusing on data orchestration, observability, and scalable architectures.

You will work with AWS services, Medallion architecture, and DataOps practices to deliver reliable data products for insurance clients.

The role requires strong Python, PySpark, SQL skills and a proactive approach to cost management and performance tuning.

Qualifications

• Hands-on experience with AWS and data engineering in a modern DataOps environment.
• Deep knowledge of Medallion architecture and data platforms.
• Strong SQL, Python, and PySpark proficiency.
• Experience with XML data handling and data quality.

Skills

DataOps

Data pipelines

ETL/ELT

CI/CD

Observability

SLA/SLOs

Root Cause Analysis

Release lifecycle

Automated testing

AWS

Medallion architecture

Terraform

CloudFormation

Python

PySpark

SQL

XML handling

FinOps

IAM

Cost optimization

Job description

At ValueMomentum’s Technology Center, we are a team of passionate engineers who thrive on tackling complex business challenges with innovative solutions while transforming the P&C insurance value chain. We achieve this through strong engineering foundation and continuously refining our processes, methodologies, tools, agile delivery teams, and core engineering archetypes. Our core expertise lies in six key areas: Cloud Engineering, Application Engineering, Data Engineering, Core Engineering, Quality Engineering, and Domain expertise

Skills:

• DataOps builds and manages the automated systems, pipelines, and tools that move and test data inside a company.
• Operate, automate, monitor, and continuously improve core data platforms to reduce waste, improve data flow, and ensure maximum uptime for structured datasets and analytics.
• Design and optimize robust data pipeline automation for ETL/ELT workloads, including orchestration, scheduling, and CI/CD to streamline data extraction and processing.
• Implement deep observability, manage logs, automate health checks, and rigorously track SLAs/SLOs to increase data reliability.
• Lead rapid incident response, stakeholder communications, and Root Cause Analysis (RCA) to continuously identify process gaps and correct them.
• Manage the end-to-end release lifecycle, executing automated testing (unit, performance, and end-to-end tests), smooth deployments, rollbacks, and performance tuning.
• Partner with managed service providers to test and adopt new solutions that adhere to DataOps best practices and ensure contract SLAs are met.
• Translate technical metrics into clear executive reports and facilitate collaboration with data and BI teams to enhance the quality of data products.
• Strong hands-on experience with AWS, Medallion architecture, and modern DataOps practices. Deep understanding of complex XML handling.
• Deep expertise in AWS Infrastructure (EC2, EKS, S3, Glue, Lambda), IAM, and ensuring stringent security standards are applied across all data pipelines.
• Proficient in Infrastructure as Code using Terraform and AWS CloudFormation.
• Design data engineering assets, develop reusable frameworks and patterns, enforce standards, and leverage AI-assisted coding tools (Codex).
• Strong FinOps awareness to monitor, control, and optimize cloud costs across large data environments.
• Highly proficient in Python, PySpark, and SQL.

ValueMomentum is an Equal Opportunity Employer committed to fostering a diverse and inclusive workplace. We make all employment decisions based on qualifications, merit, and business needs, without regard to race, color, religion, sex, gender identity or expression, sexual orientation, national origin, age, disability, protected veteran status, genetic information, or any other characteristic protected by applicable federal, state, or local law.

We are also committed to providing reasonable accommodations to qualified individuals with disabilities and applicants throughout the recruitment process, in accordance with applicable laws.