Remote Principal Data Engineer: AI-Driven Data Platform

Optum; Eden Prairie (MN); Remote; USD 113,000 - 193,000; Full time

Benefits offered by this job

Comprehensive benefits

Equity stock purchase

401k contribution

Telecommuter policy adherence

Job summary

Optum in the United States is seeking a Principal Data Engineer to design and develop scalable cloud data systems in Azure, including Databricks and Snowflake, for ML insights and automations. You will build ETL/ELT pipelines, manage Spark workflows, and deploy AI-enabled data solutions across healthcare data platforms.

The role emphasizes security, privacy, and high performance, with leadership responsibilities mentoring engineers and collaborating with stakeholders to deliver impactful data

Qualifications

• 8+ years of software or data engineering experience with data integration, modeling, and ETL/ELT.
• 5+ years hands-on Python development.
• 4+ years with Spark/PySpark and distributed processing.
• 5+ years advanced SQL experience.
• 1+ years designing REST/GraphQL APIs.
• 1+ years integrating LLMs/AI into workflows.
• 1+ years building data solutions on Azure Databricks/Snowflake.
• 1+ years CI/CD and IaC practices.

Responsibilities

• Design scalable cloud applications and reusable patterns in Azure.
• Build and optimize large-scale data pipelines on Databricks/Spark.
• Develop AI-powered data solutions and dashboards.
• Architect and evolve data engineering standards and patterns.
• Improve data reliability, quality, and system efficiency.
• Mentor other data engineers and provide technical direction.
• Collaborate with stakeholders to decompose requirements and estimate work.
• Evaluate trends to inform design and innovation.
• Maintain performance and scalability best practices.

Skills

Python development

SQL optimization

Data modeling

Tools

Azure Databricks

Snowflake

Apache Spark

Job description

Optum in the United States is seeking a Principal Data Engineer to design and develop scalable cloud data systems in Azure, including Databricks and Snowflake, for ML insights and automations. You will build ETL/ELT pipelines, manage Spark workflows, and deploy AI-enabled data solutions across healthcare data platforms.

The role emphasizes security, privacy, and high performance, with leadership responsibilities mentoring engineers and collaborating with stakeholders to deliver impactful data