Data Engineering Lead

Optum India; Bengaluru; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

Optum India is seeking a Senior Data Engineer to join Bengaluru-based teams focused on data-intensive applications and agentic data engineering using Gen AI/LLM models. You will work with architects and software engineers to deliver scalable data pipelines, ETL processes, and analytics-ready data stores.

Responsibilities include designing and implementing end-to-end data architectures, ensuring reliability and performance, and enabling continuous delivery in a DevOps environment.

Qualifications

• B.Tech in CS or similar field with 5+ years in Data Engineering and Gen AI in data engineering.
• Experience in ETL/Pipeline development using Azure Databricks, Spark and Data Factory.
• Proficiency in Python and data ingestion, prep, integration, and operationalization.
• Experience with Azure Synapse, Snowflake, and data warehousing concepts.
• Familiarity with Azure services like Functions, Cosmos and Data Lake Store.

Responsibilities

• Collaborate with architects and engineers to deliver high-quality data solutions.
• Design, develop, test, and maintain data-intensive applications including ETL and data storage.
• Leverage Gen AI and LLMs to design agentic data engineering solutions.
• Support continuous delivery and DevOps within the team.
• Build and maintain configuration management, deployment strategies, and monitoring.
• Contribute to data platform quality, resilience, and security.
• Participate in system analyses, design walkthroughs, and code reviews.
• Drive automation and improvement of data workflows and processes.
• Maintain production products, documentation, and environments; resolve issues promptly.

Skills

Gen AI LLM

Python

Azure Databricks

Apache Spark

Azure Data Factory

Azure Synapse

Snowflake

Delta Lake

MS SQL

GitHub

Azure DevOps

Spark SQL

Data Lakes

Data Warehousing

Cloud Architecture

Education

B.Tech in Computer Science

Tools

Azure Databricks

Azure Data Factory

Azure Synapse

Snowflake

Delta Lake

GitHub

Azure DevOps

Job description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities

• Work with solution architects and other software engineers to evaluate functional and non-functional requirements and deliver creative, high-quality solutions
• Design, develop, test and maintain data intensive applications including ETL, relational and non-relational data storage, data application development
• Leverage AIDLC & design Agentic data engineering solution by using available Gen AI & LLM models
• Follow and improve on processes for continuous delivery and DevOps within your team
• Build and main configuration management and automation tools, deployment strategies/processes, monitoring tools
• Collaborate on quality strategies that ensure our data platform is correct, resilient, scalable and secure
• Participate in and provide input for system analysis, design walkthroughs and code reviews
• Participating in defect review and triage
• Adhere to design/coding standards and constantly improve the way we build and deliver software
• Technical analysis of existing reporting solutions to identify opportunities for improvement both from a best practice and quality/ performance improvement perspective
• Drive continuous improvement and automation solutions and processes
• Maintain production products, solutions, documentation, and environments to ensure optimal health, including resolving production issues and responding quickly to priority problems
• Comply with all applicable Company policies, procedures, and business directives, changes including those relating to work location, team assignments, work schedules, and flexible work arrangements

Required Qualifications

• B.Tech required in computer science or similar field with minimum 5 years' experience of Data Engineering and at least 1 years' experience leveraging Gen AI LLM models to design agentic solutions in data engineering space
• Experience in ETL/Pipeline Development using tools such as Azure Databricks/Apache Spark and Azure Data Factory with development expertise on batch and real-time data integration
• Experience in programming using Python
• Experience in data ingestion, preparation, integration and operationalization techniques in optimally addressing the data requirements
• Experience in Cloud data warehouse like Azure Synapse, Snowflake analytical warehouse
• Experience with Orchestration tools, Azure DevOps and GitHub
• Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts
• Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL
• Experience to own end-to-end development, including coding, testing, debugging and deployment
• Experienced in Software Engineering practices like Reliability Engineering, Deployment planning, Fault Tolerant architecture, Test Automation
• Extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies
• Ability to provide solutions that are forward-thinking in data and analytics
• Proven team oriented with solid collaboration, prioritization, and adaptability skills
• Proven excellent written and verbal communication skills including presentation skills
• Familiarity with Azure services like Azure functions, Azure Data Lake Store, Azure Cosmos
• Familiarity with Healthcare business data models

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.