Remote Senior Data Engineer Cloud-Native ETL & ML Pipelines

UnitedHealth Group; Eden Prairie (MN); Remote; USD 92,000 - 164,000; Full time

Benefits offered by this job

Comprehensive benefits

Equity stock purchase program

401(k) plan

Job summary

UnitedHealth Group in Eden Prairie, MN is seeking a Senior Data Engineer to design and build scalable, cloud-native data pipelines on Azure and Databricks.

You will collaborate with Data Science teams to operationalize ML models, feature stores, and streaming analytics, while upholding data quality and responsible AI practices.

This role offers telecommuting from anywhere in the U.S. and a comprehensive benefits package.

Qualifications

• 4+ years of data engineering with Python and PySpark.
• 4+ years building scalable ETL/ELT pipelines using Databricks.
• 4+ years in Agile/Scrum environments.
• 4+ years using Azure Databricks and Delta Lake.
• 3+ years with Azure Data Factory (ADF) or ADLS.
• 2+ years of unit testing and data validation.
• 4+ years SQL/PL-SQL experience.
• Experience operationalizing ML models or AI pipelines is a plus.

Responsibilities

• Design and develop scalable ETL/ELT data pipelines on Azure Databricks.
• Collaborate with Data Science teams to operationalize ML models.
• Build cloud-native data solutions with ADLS and Delta Lake.
• Ensure data quality, governance, and security across data lifecycle.
• Implement CI/CD automation and code reviews in CI/CD pipelines.
• Optimize performance and cost-efficiency of batch and streaming jobs.
• Provide production support and on-call coverage.
• Develop reusable engineering accelerators and automation scripts.

Skills

Python

PySpark

Databricks

Azure Databricks

Agile/Scrum

CI/CD

GitHub Actions

Azure DevOps

Azure Data Factory

Azure Data Lake Storage

SQL

Unit testing

Education

Bachelor's degree in Computer Science, Engineering, IT, or related field

Tools

Databricks Delta Live Tables (DLT)

Job description

UnitedHealth Group in Eden Prairie, MN is seeking a Senior Data Engineer to design and build scalable, cloud-native data pipelines on Azure and Databricks.

You will collaborate with Data Science teams to operationalize ML models, feature stores, and streaming analytics, while upholding data quality and responsible AI practices.

This role offers telecommuting from anywhere in the U.S. and a comprehensive benefits package.