Senior Data Engineer - Databricks & Snowflake

Optum; Hyderabad; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Optum is seeking a Senior Data Engineer to design, build, and optimize data platforms using Databricks and Snowflake on Azure. You will transform data for analytics, improve data quality, and scale data stores across domains in a global healthcare-focused environment.

The role requires strong programming, SDLC/Agile experience, and hands-on work with big data technologies like Kafka, Spark, and Databricks, plus solid knowledge of SQL databases and ETL tools.

Qualifications

• BE/BTech or equivalent experience.
• 4+ years designing and supporting distributed data systems at scale.
• 3+ years relational database delivery (Oracle, SQL Server, MySQL).
• 3+ years SDLC experience.
• 3+ years Agile Delivery.
• 3+ years programming (Python, Java, Go, Scala).
• 2+ years ETL tools (SSIS, Informatica, Datastage).
• 2+ years Snowflake cloud DW delivery.
• 3+ years big data/streaming (Kafka, Spark, Databricks).
• 2+ years cloud exposure, preferably Azure.

Responsibilities

• Maintain, improve, and transform data in operational/analytic databases.
• Design and deploy data platforms across domains.
• Ensure data quality, governance, security and compliance.
• Build scalable data stores and data enrichment.
• Collaborate across teams to deliver high-performance data solutions.

Skills

Distributed data systems

Python/Java/Go/Scala

Kafka/Spark/Databricks

Azure cloud

Data governance

SDLC/Agile

Education

BE/BTech or equivalent

Tools

Databricks

Snowflake

SQL Databases

ETL tools (SSIS/Informatica/etc)

Kubernetes/OpenShift

GitHub/Jenkins/Grafana/Prometheus

Azure

Job description

Improve the lives of others while Caring. Connecting. Growing together.

Job Description - Senior Data Engineer - Databricks & Snowflake (2385424)

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Intelligent Data Platform is a Microsoft Azure commercial cloud based data platform. We are building the technology and data platform to enable OptumCare to pursue complementary strategies of developing local market focused value based care arrangements and driving the quadruple aim at a national level. The IDP will enable CDOs to easily manage their own data while also providing a mechanism to allow for enterprise-wide aggregation and normalization of data.

Primary Responsibilities

• Maintain, improve, clean, and manipulate data in the business operational and analytics databases.
• Design and deploy data platforms across multiple domains ensuring operability.
• Transform data for meaningful analyses.
• Improve data efficiency, reliability and quality.
• Create data enrichment.
• Build high performance.
• Ensure data integrity.
• Create and manage data stores at scale.
• Ensure data governance - security, quality, access and compliance.
• You’ll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed.

Primary Responsibility

• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications

• BE/BTECH or equivalent experience
• 4+ years of overall experience designing, coding and supporting distributed, data intensive systems at scale
• 3+ years of experience with relational database delivery - Oracle, SQL Server & mysql
• 3+ years of experience working within the Software Development Life Cycle (SDLC)
• 3+ years of experience in Agile Delivery
• 3+ years of Experience with programming languages (Python, Java, Go, scala, etc)
• 2+ years of hands‑on experience with ETL tools (SSIS, Informatica, Datastage, etc)
• 2+ years of Experience in delivering Data Platforms involving Snowflake cloud DW
• 3+ years of Hands‑on experience of big data and streaming frameworks - Kafka , Spark & Databricks
• 2+ years of. Experience and working exposure in cloud environment, preferably Azure

Preferred Qualifications

• Experience in DevOps Automation tools (Oozie, Python, etc)
• Hands‑on experience in full automated testing framework (unit & integration),cucumber, spock, Go unit test, Junit
• Hands‑on experience on using PAAS like - Kubernetes, Openshift
• Hands‑on experience on working on CICD platform and monitoring - namely Github, Jenkins, Grafana, Prometheus
• Experience and working exposure in cloud environment, preferably Azure Excellent communication skills with ability to describe data/capability stories and explain value to customers

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone–of every race, gender, sexuality, age, location and income–deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes — an enterprise priority reflected in our mission.

UnitedHealth Group is committed to working with and providing reasonable accommodations to individuals with physical and mental disabilities. If you need special assistance or accommodation for any part of the application process, please call 1-866-566-8715 to be connected to Recruitment Services. Recruitment Services hours of operation are 7 a.m. to 7 p.m. CT, Monday through Friday.

UnitedHealth Group is a registered service mark of UnitedHealth Group, Inc. The UnitedHealth Group name with the dimensional logo, as well as the dimensional logo alone, are both service marks for the UnitedHealth Group, Inc.

Diversity creates a healthier atmosphere: UnitedHealth Group is an Equal Employment Opportunity/Affirmative Action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status, sexual orientation, gender identity or expression, marital status, genetic information, or any other characteristic protected by law.

UnitedHealth Group is a drug‑free workplace. Candidates are required to pass a drug test before beginning employment.