Senior Data Engineer - Databricks, Snowflake, SQL, ETL, Spark, Data Warehouse

Optum; Hyderabad; On-site; INR 2,600,000 - 4,800,000; Full time

Job summary

Optum is seeking a Senior Data Engineer to design and deliver robust ETL pipelines and data warehousing solutions using Databricks, Snowflake, SQL, and Spark. You will collaborate with cross-functional teams to translate business needs into scalable data architectures.

The role emphasizes cloud-based data integration, CI/CD, and production support, with a focus on performance and reliability within a healthcare data domain.

Qualifications

• 3+ years of total experience.
• 3+ years of experience in designing and developing ETL solutions.
• 3+ years of working knowledge in a Data Warehouse/BI environment.
• Experience in Data Integration and Data Warehousing and Cloud.
• Solid DBMS experience: Snowflake, SQL, Hive, Databricks.
• Good experience in job schedulers like Airflow.
• Experience in cloud environments, preferably Azure.
• Experience with CI/CD pipelines using Jenkins, GitHub Actions.
• Experience with Agile/Scrum methodologies.
• Expertise in Spark and big data processing.
• Strong SQL skills including complex constructs.

Responsibilities

• Understand Caredata architecture/domain and contribute to new/existing business requests.
• Develop efficient and high performing ETL solutions.
• Design, develop, test and performance tune complex ETLs, Automation and AI skills.
• Ensure cloud infra is intact and resolve issues encountered.
• Schedule deployed pipelines using Airflow with proper dependency hierarchy.
• Move code/app to higher environments from non-prod for go-live.
• Build and maintain pipelines and automation via GitOps (GitHub Actions, Jenkins).
• Provide production support and maintain data pipelines to data warehouse or storage.
• Communicate with technical and non-technical stakeholders; collaborate cross-functionally.

Skills

ETL design

Data integration

Data warehousing

Big data (Spark)

CI/CD

Agile/Scrum

SQL proficiency

Analytical skills

Collaboration

Education

B.E/B.Tech./MCA or Graduation

Bachelor or master’s degree in computer science or information technology or equivalent

Tools

Snowflake

SQL

Hive

Databricks

Airflow

Jenkins

GitHub Actions

Azure

Spark

Job description

Improve the lives of others while Caring. Connecting. Growing together.

Job Description - Senior Data Engineer - Databricks, Snowflake, SQL, ETL, Spark, Data Warehouse (2387311)

Senior Data Engineer - Databricks, Snowflake, SQL, ETL, Spark, Data Warehouse - 2387311

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities:

• Understand Caredata architecture/domain and start contributing for new/existing business requests
• Develop efficient and high performing ETL solutions
• Design, develop, test and performance tune complex ETLs,Automation and AI Skills
• To make sure all the cloud infra is intact and resolve any issues encountered
• Schedule the deployed pipelines using Airflow following proper dependency hierarchy of jobs
• Move the code/application to higher environments(stage/prod) from non-prod for go-live
• Build and maintain pipelines and automation through Git Ops (GitHub Actions, Jenkins, etc)
• Supports a work environment in which people can perform to the best of their abilities. Holds self-accountable for technical abilities, productive results, and leadership attributes
• Productions Support
• Design and implement efficient data pipelines to ensure a smooth flow of information into the data warehouse or storage system
• Demonstrates and applies understanding of modern development methodologies and tools to develop, deploy, and maintain impactful, high-value market solutions
• Communicate effectively with technical and non-technical stakeholders
• Collaborate with cross-functional teams
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regard to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:

• B.E/B.Tech./MCA/Graduation
• Bachelor or master’s degree in computer science or information technology or equivalent
• 3+ years of total experience
• 3+ years of experience in designing and developing ETL solutions
• 3+ years of working knowledge in a Data Warehouse/BI environment
• Experience in Data Integration and Data Warehousing and Cloud
• Solid DBMS experience: Snowflake, SQL, Hive, Databricks
• Good experience in job schedulers like Airflow
• Good experience in working on cloud environment, preferably Azure
• Experience with Continuous Integration CI/CD pipelines using Jenkins, GitHub Actions
• Experience with contemporary SDLC methodologies such as Agile, Scrum
• Expertise in BigData frameworks like Spark
• Solid SQL skills including complex SQL constructs, DDL generation
• Proven excellent organizational, analytical, writing, problem solving and interpersonal skillsGood to have Healthcare Domains exposure
• Proven excellent written and verbal communication skills, co-ordination skills

Preferred Qualification:

• Databricks, snowflake, SQL queries, ETL, sparq, Data warehouse

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.

UnitedHealth Group is committed to working with and providing reasonable accommodations to individuals with physical and mental disabilities. If you need special assistance or accommodation for any part of the application process, please call 1-866-566-8715 to be connected to Recruitment Services. Recruitment Services hours of operation are 7 a.m. to 7 p.m. CT, Monday through Friday.

UnitedHealth Group is a registered service mark of UnitedHealth Group, Inc. The UnitedHealth Group name with the dimensional logo, as well as the dimensional logo alone, are both service marks for the UnitedHealth Group, Inc.

Diversity creates a healthier atmosphere: UnitedHealth Group is an Equal Employment Opportunity/Affirmative Action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status, sexual orientation, gender identity or expression, marital status, genetic information, or any other characteristic protected by law.

UnitedHealth Group is a drug-free workplace. Candidates are required to pass a drug test before beginning employment.