Senior Data Engineer: AI Pipelines & Cloud (Remote)

Optum; Eden Prairie (MN); On-site; USD 92,000 - 164,000; Full time

Benefits offered by this job

Remote work flexibility

Comprehensive benefits package

Job summary

Optum in Eden Prairie, MN, invites a Senior Data Engineer to join the UHC Core Data KTLO team. You will design and deliver AI-powered data solutions, build scalable pipelines with PySpark, SQL, and Databricks, and support Azure Data Factory and Kafka-based workloads.

You can telecommute from anywhere in the U.S. This role emphasizes KTLO tasks, data security, and platform stability as you drive cloud modernization and governance across healthcare data.

Qualifications

• 5+ years of experience in Data Engineering or related field.
• 3+ years with Python, SQL, Spark/PySpark, and Databricks.
• 2+ years of data warehousing, dimensional modeling, and database design.
• 2+ years with Azure Data Factory, Azure Data Lake, or related cloud data services.
• 2+ years with Apache Kafka or streaming technologies.
• 2+ years of production support and KTLO experience.
• 1+ years building data pipelines using Databricks Medallion Architecture.
• 1+ years of CI/CD and automation practices.

Responsibilities

• Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
• Design, develop, and maintain scalable data pipelines using Python, PySpark, SQL, and Databricks
• Build and support batch and streaming data solutions using Kafka and Azure Data Factory
• Support KTLO activities including production support, incident resolution, vulnerability remediation, platform upgrades, and system reliability
• Implement automation and AI-enabled solutions to improve engineering efficiency and operational processes
• Optimize data models, queries, and large-scale data processing workloads
• Collaborate with business and technology partners to deliver high-quality data solutions
• Ensure compliance with security, governance, and healthcare data privacy requirements
• Contribute to CI/CD, monitoring, and cloud modernization initiatives
• Apply and promote data warehousing, data modeling, and database design best practices
• Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI

Skills

Python

SQL

Spark/PySpark

Databricks

Data Warehousing

Dimensional Modeling

Database Design

CI/CD

Data Pipelines

Education

Bachelor's degree in Computer Science, Information Systems, or related field

Tools

Azure Data Factory

Azure Data Lake

Apache Kafka

Databricks Medallion Architecture

Power BI/Looker/Tableau

Docker

Job description

Optum in Eden Prairie, MN, invites a Senior Data Engineer to join the UHC Core Data KTLO team. You will design and deliver AI-powered data solutions, build scalable pipelines with PySpark, SQL, and Databricks, and support Azure Data Factory and Kafka-based workloads.

You can telecommute from anywhere in the U.S. This role emphasizes KTLO tasks, data security, and platform stability as you drive cloud modernization and governance across healthcare data.