Data Engineering Consultant (Azure Data Bricks, ADF, SQL, Python)

Optum India; Hyderabad; On-site; INR 2,500,000 - 4,000,000; Full time

Job summary

Optum India is seeking an experienced data engineer to support end-to-end data management solutions, from research to deployment, across health care domains. You will lead data acquisition, design ETL/ELT pipelines, and drive data quality improvements while collaborating with analytics teams to evolve data platforms.

The role requires 5+ years in data engineering, strong SQL/Python/Scala skills, and hands-on experience with Azure Data Factory, Databricks, Spark, and Informatica/DataStage.

Qualifications

• Bachelor's Degree (preferably in information technology, engineering, math, computer science, analytics, engineering or other related field)
• 5+ years of combined experience in data engineering, ingestion, normalization, transformation, aggregation, structuring, and storage
• 5+ years of combined experience working with industry standard relational, dimensional or non-relational data storage systems
• 5+ years of experience in designing ETL/ELT solutions using tools like Informatica, DataStage, SSIS , PL/SQL, T-SQL, etc.
• 5+ years of experience in managing data assets using SQL, Python, Scala, VB.NET or other similar querying/coding language
• 3+ years of experience working with healthcare data or data to support healthcare organizations
• 3+ years of experience in Microsoft Azure Cloud, Azure Data Factory, Data Bricks, Spark, Scala / Python , ADO

Responsibilities

• Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions
• Utilize knowledge of various data management technologies to drive data engineering projects
• Lead data acquisition efforts to gather data from various structured or semi-structured source systems of record to hydrate client data warehouse and power analytics across numerous health care domains
• Leverage combination of ETL/ELT methodologies to pull complex relational and dimensional data to support loading DataMart's and reporting aggregates
• Eliminate unwarranted complexity and unneeded interdependencies
• Detect data quality issues, identify root causes, implement fixes, and manage data audits to mitigate data challenges
• Implement, modify, and maintain data integration efforts that improve data efficiency, reliability, and value
• Leverage and facilitate the evolution of best practices for data acquisition, transformation, storage, and aggregation that solve current challenges and reduce the risk of future challenges
• Effectively create data transformations that address business requirements and other constraints
• Partner with the broader analytics organization to make recommendations for changes to data systems and the architecture of data platforms
• Support the implementation of a modern data framework that facilitates business intelligence reporting and advanced analytics
• Prepare high level design documents and detailed technical design documents with best practices to enable efficient data ingestion, transformation and data movement
• Leverage DevOps tools to enable code versioning and code deployment
• Leverage data pipeline monitoring tools to detect data integrity issues before they result into user visible outages or data quality issues
• Leverage processes and diagnostics tools to troubleshoot, maintain and optimize solutions and respond to customer and production issues
• Continuously support technical debt reduction, process transformation, and overall optimization
• Leverage and contribute to the evolution of standards for high quality documentation of data definitions, transformations, and processes to ensure data transparency, governance, and security
• Ensure that all solutions meet the business needs and requirements for security, scalability, and reliability
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Skills

Data engineering

SQL proficiency

Python programming

Scala programming

Healthcare data experience

Cloud data platforms

Education

Bachelor's Degree in IT/engineering/science

Tools

Informatica

DataStage

SSIS

PL/SQL

T-SQL

Azure Data Factory

Databricks

Spark

Job description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.

The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best.

Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities.

Come make an impact on the communities we serve as you help us advance health optimization on a global scale.

Join us to start Caring. Connecting. Growing together.

Primary Responsibilities

• Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions
• Utilize knowledge of various data management technologies to drive data engineering projects
• Lead data acquisition efforts to gather data from various structured or semi-structured source systems of record to hydrate client data warehouse and power analytics across numerous health care domains
• Leverage combination of ETL/ELT methodologies to pull complex relational and dimensional data to support loading DataMart's and reporting aggregates
• Eliminate unwarranted complexity and unneeded interdependencies
• Detect data quality issues, identify root causes, implement fixes, and manage data audits to mitigate data challenges
• Implement, modify, and maintain data integration efforts that improve data efficiency, reliability, and value
• Leverage and facilitate the evolution of best practices for data acquisition, transformation, storage, and aggregation that solve current challenges and reduce the risk of future challenges
• Effectively create data transformations that address business requirements and other constraints
• Partner with the broader analytics organization to make recommendations for changes to data systems and the architecture of data platforms
• Support the implementation of a modern data framework that facilitates business intelligence reporting and advanced analytics
• Prepare high level design documents and detailed technical design documents with best practices to enable efficient data ingestion, transformation and data movement
• Leverage DevOps tools to enable code versioning and code deployment
• Leverage data pipeline monitoring tools to detect data integrity issues before they result into user visible outages or data quality issues
• Leverage processes and diagnostics tools to troubleshoot, maintain and optimize solutions and respond to customer and production issues
• Continuously support technical debt reduction, process transformation, and overall optimization
• Leverage and contribute to the evolution of standards for high quality documentation of data definitions, transformations, and processes to ensure data transparency, governance, and security
• Ensure that all solutions meet the business needs and requirements for security, scalability, and reliability
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Builder Responsibilities

Design, develop, and deploy AI-powered solutions using no-code, low-code, and advanced platforms, translating business needs into scalable applications that enhance products, workflows, and decision-making.

Required Qualifications

• Bachelor's Degree (preferably in information technology, engineering, math, computer science, analytics, engineering or other related field)
• 5+ years of combined experience in data engineering, ingestion, normalization, transformation, aggregation, structuring, and storage
• 5+ years of combined experience working with industry standard relational, dimensional or non-relational data storage systems
• 5+ years of experience in designing ETL/ELT solutions using tools like Informatica, DataStage, SSIS , PL/SQL, T-SQL, etc.
• 5+ years of experience in managing data assets using SQL, Python, Scala, VB.NET or other similar querying/coding language
• 3+ years of experience working with healthcare data or data to support healthcare organizations
• 3+ years of experience in Micorsoft Azure Cloud, Azure Data Factory, Data Bricks, Spark, Scala / Python , ADO

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.