Data Engineer I

Vālenz Health; Northern (KY); Hybrid; USD 75,000 - 105,000; Full time

Benefits offered by this job

Healthcare benefits

401(k) with match

Remote-first environment

Job summary

Valenz Health is seeking a Data Engineer I to build scalable data pipelines in a cloud lakehouse. You’ll transform and integrate healthcare data from multiple sources for analytics and reporting.

You’ll collaborate with analytics teams, implement ETL/ELT processes using SQL and Python, and help migrate on-prem data to Azure Databricks Delta Lake. This fully remote role requires US-based work location.

Qualifications

• 1+ year of experience in data engineering or related field.
• Strong SQL and Python capabilities for data manipulation and integration.
• Experience with ETL/ELT processes and data warehousing concepts.

Responsibilities

• Develop, maintain, and enhance data pipelines that ingest, transform, validate, and integrate data from multiple sources.
• Support migration of on-prem SQL Server data systems to a cloud lakehouse using Azure Databricks and Delta Lake.
• Develop and maintain ETL/ELT processes using SQL, Python, PySpark, and Spark SQL.
• Apply lakehouse architecture standards, including schema enforcement, data quality checks, and ACID transactions.
• Build and maintain data models to support analytics, reporting, and warehousing needs.
• Collaborate with data analysts, data scientists, and business stakeholders to understand data requirements and workflows.

Skills

SQL

Python

Databricks

Airflow

Data Modeling

Education

Bachelor's degree in Computer Science, Engineering or related field

Tools

Azure Databricks

Spark

Delta Lake

Azure Data Lake Storage

Python

Job description

Vālenz Health® is the destination for employers, brokers, payers, and providers to reduce costs, improve quality, and elevate the healthcare experience. Through advanced technology and clinical expertise, Valenz creates a distinctly different approach to a complex healthcare system. With our solutions, we execute across the entire healthcare journey — from member experience to payment integrity, provider quality, and plan performance. With one of America’s largest cost, quality and utilization datasets, we create greater transparency, flexibility, and cost containment — empowering members and employers with the information they need to make smarter, more cost-effective decisions.

About This Opportunity

As a Data Engineer I, you’ll help develop and maintain scalable data pipelines and solutions within our modern, cloud-based data platform. You’ll transform, validate, and integrate healthcare data from multiple sources to ensure accurate, reliable, and accessible data for analytics, reporting, and broader business needs. You’ll also partner with Analytics and other cross‑functional teams to translate data requirements into effective solutions while supporting the continued growth and evolution of our cloud-based lakehouse architecture.

Things You’ll Do Here

• Develop, maintain, and enhance data pipelines that ingest, transform, validate, and integrate data from multiple internal and external sources.
• Support the migration of on‑premise SQL Server data systems to a cloud‑based lakehouse architecture using Azure Databricks and Delta Lake.
• Develop and maintain ETL/ELT processes using SQL, Python, PySpark, and Spark SQL.
• Apply established lakehouse and Delta Lake architecture standards, including schema enforcement, data quality controls, ACID transactions, and data versioning.
• Build and maintain data models that support analytics, reporting, and data warehousing needs.
• Implement data quality checks, validation processes, and monitoring to ensure the accuracy, completeness, and reliability of data pipelines.
• Orchestrate and monitor data workflows using Databricks Workflows, Apache Airflow, or similar technologies.
• Troubleshoot pipeline failures, data quality issues, and performance concerns, identifying root causes and implementing appropriate solutions.
• Support the optimization of data pipelines for performance, scalability, reliability, and cost efficiency.
• Collaborate on CI/CD practices for data engineering solutions, including source control, testing, deployment, and version management.
• Partner with data analysts, data scientists, and business stakeholders to understand data requirements and develop supporting pipelines and data structures.
• Document data pipelines, transformations, technical processes, and data structures to support maintainability and knowledge sharing.
• Participate in code reviews, testing, and Agile development processes to support consistent engineering standards and continuous improvement.
• Stay current on data engineering technologies and contribute ideas for improving the organization’s evolving data platform.
• Perform other duties as assigned.

Reasonable accommodation may be made to enable individuals with disabilities to perform essential duties.

What You’ll Bring to the Team

• Bachelor's degree in Computer Science, Engineering, Data Science, Mathematics, Statistics, or a related quantitative or technical field, or equivalent practical experience.
• 1+ years of experience in data engineering, software development, data analytics, or a related role involving similar technical responsibilities.
• Working knowledge of SQL and Python, with experience using these technologies to manipulate, transform, or process data.
• Experience developing or supporting ETL/ELT processes, data pipelines, data integrations, or similar data engineering solutions.
• Understanding of relational databases, data modeling concepts, and data warehousing principles.
• Ability to troubleshoot data and technical issues, investigate root causes, and develop effective solutions.
• Strong attention to detail with a commitment to data accuracy, quality, and validation.
• Ability to work with complex or incomplete data and navigate ambiguity to reach reliable conclusions.
• Strong organizational and time management skills with the ability to manage multiple priorities and assignments.
• Effective written and verbal communication skills, including the ability to explain technical concepts and requirements to technical and non‑technical stakeholders.

A plus if you have…

• Experience with Azure Databricks, Spark, PySpark, Spark SQL, or Delta Lake.
• Experience with Microsoft Azure services such as Azure Data Lake Storage, Blob Storage, or Synapse Analytics.
• Experience with pipeline orchestration tools such as Databricks Workflows, Apache Airflow, or similar technologies.
• Familiarity with Git, Azure DevOps, CI/CD practices, automated testing, and source control.
• Experience working with healthcare data, including medical claims, eligibility, provider network, pharmacy claims, or similar datasets.
• Exposure to cloud data migrations or modernization of traditional relational database and ETL environments.
• Familiarity with batch and streaming data processing concepts.
• Understanding of data quality frameworks, monitoring, and data governance practices.

Where You’ll Work

This is a fully remote position, and we’ll provide all the necessary equipment!

• Work Environment: You’ll need a quiet workspace that is free from distractions.
• Technology: Reliable internet connection—if you can use streaming services, you’re good to go!
• Security: Adherence to company security protocols, including the use of VPNs, secure passwords, and company‑approved devices/software.
• Location: You must be US based, in a location where you can work effectively and comply with company policies such as HIPAA.

Why You'll Love Working Here

Our mission is to advance healthcare through technology and expertise to optimize cost, quality, access, and utilization for all. We bring that mission to life through our commitment to Collaboration, Performance, Transparency, and Trust—the core values that guide how we work with our members, our customers, and each other.

Benefits

• Generously subsidized company‑sponsored Medical, Dental, and Vision insurance, with access to services through our own products, Healthcare Blue Book and KISx Card.
• Spending account options: HSA, FSA, and DCFSA
• 401K with company match and immediate vesting
• Flexible working environment
• Generous Paid Time Off to include vacation, sick leave, and paid holidays
• Employee Assistance Program that includes professional counseling, referrals, and additional services
• Paid maternity and paternity leave
• Pet insurance
• Employee discounts on phone plans, car rentals and computers
• Community giveback opportunities, including paid time off for philanthropic endeavors

At Valenz, we celebrate, support, and thrive on inclusion, for the benefit of our associates, our partners, and our products. Valenz is committed to the principle of equal employment opportunity for all associates and to providing associates with a work environment free of discrimination and harassment. All employment decisions at Valenz are based on business needs, job requirements, and individual qualifications, without regard to race, color, religion or belief, national, social, or ethnic origin, sex (including pregnancy), age, physical, mental or sensory disability, HIV Status, sexual orientation, gender identity and/or expression, marital, civil union or domestic partnership status, past or present military service, family medical history or genetic information, family or parental status, or any other status protected by the laws or regulations in the locations where we operate. We will not tolerate discrimination or harassment based on any of these characteristics.