Software Engineer - Data Engineer

UnitedHealth Group; Hyderabad; On-site; INR 1,400,000 - 2,200,000; Full time

Job summary

UnitedHealth Group is seeking a data engineer to design and implement large-scale data pipelines using Azure Databricks, Spark, and modern data platforms. The role emphasizes building ML-ready data features, integrating APIs and diverse data sources, and shaping data architecture.

The position requires 3+ years in data engineering, Python, SQL, and cloud-based ETL/ELT work, with mentoring responsibility and a focus on data quality and process automation. Hyderabad-based, full-time engagement.

Qualifications

• 3+ years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes to provide quality data and analytics solutions.
• 3+ years of experience in Python.
• 2+ years of hands-on experience with Redis-backed state management and event-driven processing.
• 2+ years of experience in Apache Spark (PySpark/Spark SQL).

Responsibilities

• Design and develop ETL/ELT solutions on Azure Databricks, LakeBase and Spark.
• Develop, implement, and deploy large scale data pipelines empowering machine learning algorithms, insights generation, BI dashboards, reporting and new data products.
• Design, build, optimize, and manage modern large-scale data pipelines ETL/ELT processing to support data integration for analytics, ML features and predictive modelling.
• Consume data from various sources and formats.
• Write advanced SQL with performance tuning and optimization.
• Build AI-based solutions for workflow automation and efficiency.
• Mentor data engineers and provide technical direction.
• Ensure compliance with company policies and work arrangements.

Skills

Python

SQL

Spark / PySpark

REST APIs

GraphQL

Terraform

CI/CD

GitHub Actions

Tools

Azure Databricks

Snowflake

Service Bus

Redis

Spark SQL

Job description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities:

• Design and develop ETL/ELT solutions on Azure Databricks, LakeBase and Spark
• Develop, implement, and deploy large scale data pipelines empowering machine learning algorithms, insights generation, business intelligence dashboards, reporting and new data products
• Design, build, optimize, and manage modern large-scale data pipelines ETL/ELT processing to support data integration for analytics, machine learning features and predictive modelling
• Consume data from a variety of sources (RDBMS, APIs, FTPs and other cloud storage) & formats (Excel, CSV, XML, JSON, Parquet, Unstructured)
• Write advanced / complex SQL with performance tuning and optimization
• Build AI based solutions for solving business needs, process automations and improving operational efficiency
• Identify ways to improve data reliability, data integrity, system efficiency and quality
• Participate in architectural evolution of data engineering patterns, frameworks, systems, and platforms including defining best practices and standards for managing data collections and integration
• Mentor other data engineers and provide technical direction by teaching other data engineers how to leverage cloud data platforms
• Comply with all applicable Company policies, procedures, and business directives, changes including those relating to work location, team assignments, work schedules, and flexible work arrangements

Required Qualifications:

• 3+ years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes to provide quality data and analytics solutions
• 3+ years of experience in Python
• 3+ years of experience with API design and lifecycle management (GraphQL, REST, etc.)
• 2+ years of hands-on experience with Redis-backed state management and event-driven processing2 + years of experience in Apache Spark (PySpark/Spark SQL)
• 2+ years of experience building and deploying Cloud based solutions using - Azure Databricks with UC, Snowflake, Functions, Service Bus
• 2+ years of experience in SQL with designing complex data schemas and query performance optimization
• Experience building LLM integrations for workflow automation/business needs
• Experience with DevOps automation with Terraform
• Experience with CI/CD process and tools - GitHub Actions, GIT, Artifactory, Sonar

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.