Data Engineering Consultant

Optum; Hyderabad; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

Optum is seeking a Data Engineering Consultant to design and build scalable data pipelines on Azure Databricks, Spark, and Lakebase. You will enable ML features, BI reporting and data-driven decision making across diverse stakeholders.

The role emphasizes ETL/ELT design, API-driven architectures, and cloud-native patterns, with mentoring responsibilities and a focus on data reliability and governance.

Qualifications

• 5+ years of experience in data engineering and ETL/ELT processes to deliver analytics solutions.
• 5+ years of SQL design and query performance optimization.
• 3+ years of Python/Scala development.
• 3+ years of Apache Spark (PySpark) experience.
• 3+ years of Terraform/DevOps automation.
• 3+ years API design and lifecycle management (GraphQL/REST).
• 3+ years building Cloud-based solutions using Azure Databricks, Snowflake, Functions, Service Bus.
• Experience with building LLM integrations for workflow automation.
• Experience with CI/CD tools – GitHub Actions, Git, Artifactory, Sonar.

Responsibilities

• Develop scalable cloud services and reusable patterns for rapid value delivery in the public cloud.
• Build microservices, Azure functions and patterns for secure data in the public cloud.
• Mentor data engineers and promote best practices for data platforms.
• Design and develop ETL/ELT solutions on Azure Databricks, Lakebase and Spark.
• Create data pipelines for analytics, ML features and BI reporting.
• Write advanced SQL with performance tuning and optimization.
• Collaborate with stakeholders and third-party teams to drive data-driven decisions.
• Contribute to architectural evolution of data engineering patterns and standards.

Skills

Data engineering

SQL optimization

Python

Scala

Spark/PySpark

Terraform

APIs (GraphQL/REST)

Azure Databricks

LLM integrations

CI/CD tools

Tools

Snowflake

Service Bus

GitHub Actions

Artifactory

SonarQube

Job description

Improve the lives of others while Caring. Connecting. Growing together.

Job Description - Data Engineering Consultant (2388134)

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities:

• Develops services, controls, and reusable patterns that enable the team to deliver value safely, quickly, and sustainably in the public cloud
• Develop highly-scalable applications for the Azure cloud by building microservices, Azure functions, and patterns for public cloud enabling security and privacy at scale
• Foster high-performance, collaborative technical work resulting in high-quality output
• Understand new product capabilities and decompose the implementation into specific functional changes for verification
• Gather and analyze data to aid in informed decision-making while providing detailed, realistic estimates
• Interact skillfully with business stakeholders and third-party technical organizations
• Design and develop ETL/ELT solutions on Azure Databricks, LakeBase and Spark
• Develop, implement, and deploy large scale data pipelines empowering machine learning algorithms, insights generation, business intelligence dashboards, reporting and new data products
• Design, build, optimize, and manage modern large-scale data pipelines ETL/ELT processing to support data integration for analytics, machine learning features and predictive modelling
• Write advanced / complex SQL with performance tuning and optimization
• Build AI based solutions for solving business needs, process automations and improving operational efficiency
• Identify ways to improve data reliability, data integrity, system efficiency and quality
• Participate in architectural evolution of data engineering patterns, frameworks, systems, and platforms including defining best practices and standards for managing data collections and integration
• Mentor other data engineers and provide technical direction by teaching other data engineers how to leverage cloud data platforms
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:

• 5+ years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes to provide quality data and analytics solutions
• 5+ years of experience in SQL with designing complex data schemas and query performance optimization
• 3+ years of experience in Python, Scala
• 3+ years of experience in Apache Spark (PySpark/Spark SQL)
• 3+ years with DevOps automation with Terraform
• 3+ years of experience with API design and lifecycle management (GraphQL, REST, etc.)
• 3+ years of building and deploying Cloud based solutions using - Azure Databricks with UC, Snowflake, Functions, Service Bus
• Experience of building LLM integrations for workflow automation/business needs
• Experience with CI/CD process and tools – GitHub Actions, GIT, Artifactory, Sonar

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone–of every race, gender, sexuality, age, location and income–deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes — an enterprise priority reflected in our mission.

UnitedHealth Group is committed to working with and providing reasonable accommodations to individuals with physical and mental disabilities. If you need special assistance or accommodation for any part of the application process, please call 1-866-566-8715 to be connected to Recruitment Services. Recruitment Services hours of operation are 7 a.m. to 7 p.m. CT, Monday through Friday.

UnitedHealth Group is a registered service mark of UnitedHealth Group, Inc. The UnitedHealth Group name with the dimensional logo, as well as the dimensional logo alone, are both service marks for the UnitedHealth Group, Inc.

Diversity creates a healthier atmosphere: UnitedHealth Group is an Equal Employment Opportunity/Affirmative Action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status, sexual orientation, gender identity or expression, marital status, genetic information, or any other characteristic protected by law.

UnitedHealth Group is a drug-free workplace. Candidates are required to pass a drug test before beginning employment.