Senior Data Engineering Consultant

UnitedHealth Group; Hyderabad; On-site; Confidential; Full time

Benefits offered by this job

Health insurance

On-site workspace

Job summary

UnitedHealth Group’s Optum unit is seeking a data engineering professional to design and implement scalable data pipelines and data warehouses/lakes using Databricks and Snowflake in a cloud-first environment. The role blends development and operations, emphasizes Agile practices, and requires strong data modeling, architecture, Python, Spark, SQL, and CI/CD expertise.

You will collaborate across teams, mentor colleagues, and help improve data quality, governance, and analytics capabilities.

Qualifications

• Undergraduate degree or equivalent experience.
• 3+ years of experience with Data Warehouse/Data Lake (Databricks/Snowflake).
• 2+ years with Databricks, Python, Spark, PySpark, SQL, Azure Data Factory.
• 1+ years with CI/CD tools (GitHub Actions, Jenkins) and cloud-based CI/CD pipelines.

Responsibilities

• Data Engineering and Development: design, code, test, and maintain scalable data pipelines and solutions in cloud environments.
• Ingest and transform data from APIs, streaming platforms, files, and databases.
• Develop reusable patterns and promote innovation to enhance team productivity and velocity.
• Application Development and Deployment: design and develop applications in an Agile environment; implement CI/CD pipelines.
• Operations and Support: support development and operations with adaptable working hours; assist with incident management.
• Collaboration and Leadership: mentor team members; work independently on complex issues.
• Data Architecture and Engineering: design and implement Data Warehouses/Lakes using Databricks and Snowflake; ensure data quality.
• Cloud and Platform Engineering: work with PaaS and cloud data stores; provide sizing and configuration assistance.
• Database and Storage: manage NoSQL and relational databases; write SQL and data markup scripts for analytics.

Skills

Data architecture

Data modeling

CI/CD practices

Cloud-based CI/CD

GitHub

NoSQL

Relational databases

Education

Bachelor's degree or equivalent experience

Tools

Databricks

Snowflake

Python

Spark

PySpark

SQL

Azure Data Factory

GitHub Actions

Jenkins

NoSQL Databases

Relational Databases

Job description

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.

Primary Responsibilities:

• Data Engineering and Development
  • Design, code, test, document, and maintain high-quality, scalable data pipelines and solutions in cloud environments
  • Ingest and transform data from various sources including APIs, streaming platforms, files, and databases
  • Develop reusable patterns and promote innovation to enhance team productivity and velocity
• Application Development and Deployment
  • Design and develop applications in an Agile environment
  • Implement and manage CI/CD pipelines for seamless deployment
    Participate in prototyping, design reviews, and code reviews
• Operations and Support
  • Willingness to work in both development and operations roles
  • Flexibility to support operations with adaptable working hours
  • Assist with incident and problem management
• Collaboration and Leadership
  • Act as a self-starter with a proactive learning attitude
  • Serve as a resource and mentor to team members
  • Work independently on complex and less structured issues
• Technical Responsibilities
  • Data Architecture and Engineering
    • Design and implement Data Warehouses and Data Lakes using platforms like Databricks and Snowflake
    • Perform data modeling and architecture design
    • Ensure high standards of data quality and integrity
  • Cloud and Platform Engineering
    • Work with Platform-as-a-Service (PaaS) and cloud solutions, focusing on data stores and associated ecosystems
    • Manage design services, provide sizing and configuration assistance
  • Database and Storage
    • Engage in database architecture, optimization, security, and administration
    • Work with both NoSQL and relational databases
    • Write SQL and data markup scripts to support analytics and application development
  • Vendor and Business Analysis
    • Manage relationships with software and hardware vendors
    • Analyze current business practices and identify future opportunities for data leverage
• Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so

Required Qualifications:

• Undergraduate degree or equivalent experience
• 3+ years of experience with:
  • Design and implementation of Data Warehouse/Data Lake (Databricks/Snowflake)
  • Data architecture and data modeling
• 2+ years of experience with:
  • Databricks, Python, Spark, PySpark, SQL
  • Azure Data Factory
• 1+ years of experience with:
  • CI/CD tools (GitHub Actions, Jenkins, or similar)
  • Cloud-based CI/CD pipelines
  • GitHub
  • NoSQL and relational databases

Preferred Qualifications:

• Experience with Apache Kafka
• Working in Agile/Scrum environments
• Knowledge of Data ingestion from various APIs

At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.