Data Engineering Manager

Naukri E Hire Campaign; Bengaluru; Hybrid; INR 1,500,000 - 3,000,000; Full time

Job summary

Optum in Bangalore is seeking a data engineer with 7–14 years of experience to design and maintain scalable data ingestion and analytics pipelines. You will drive ETL/ELT workflows across structured and unstructured data, optimize performance, and ensure data quality and governance.

Collaboration with analysts, scientists, and product teams is essential to deliver trusted data assets. Experience with Python, SQL, Pyspark, Databricks, and cloud platforms (Azure/AWS/GCP) is required, along with a

Qualifications

• Experience building scalable data ingestion and transformation pipelines.
• Strong ETL/ELT design and optimization across sources.
• Proficiency with cloud platforms and data warehouses/lakes.
• Exposure to health care data and data governance practices.
• Ability to translate business requirements into data solutions.

Responsibilities

• Design, develop, and maintain scalable data ingestion, transformation, and integration pipelines.
• Build and optimize ETL/ELT workflows to process data from multiple sources.
• Analyze business requirements and translate them into technical data solutions.
• Develop and maintain data models, data quality frameworks, and validation processes.
• Collaborate with analysts, scientists, product teams, and stakeholders to deliver data assets.
• Monitor and optimize pipeline performance, reliability, and cost efficiency.
• Support cloud-based data platforms and data warehouse/lakehouse environments.
• Implement governance, security, lineage, and compliance standards.
• Create technical documentation, design specs, and operational procedures.
• Provide guidance to junior engineers and participate in code reviews and CI/CD.
• Troubleshoot production issues and implement sustainable solutions.
• Contribute to automation and continuous improvement across the data ecosystem.

Skills

Data Engineering

Python programming

SQL programming

Pyspark programming

Databricks

Azure / AWS / GCP

End to End Pipeline Build

Basic Data Modeling

Health care domain exposure

GenAI Exposure

Job description

Company - Optum

Exp - 7-14 yrs

Location - Bangalore

Skills - Data Engineering, Python programming, SQL programming, Pyspark programming, Databricks, Azure / AWS / GCP, End to End Pipeline Build (Extract, Transform, Load), Basic Data Modeling, Health care domain exposure, GenAI Exposure

Primary Responsibilities:

• Design, develop, and maintain scalable data ingestion, transformation, and integration pipelines
• Build and optimize ETL/ELT workflows to process structured and unstructured data from multiple sources
• Analyze business and customer requirements and translate them into technical data solutions
• Identify and resolve non-standard data challenges and moderately complex engineering problems
• Develop and maintain data models, data quality frameworks, and validation processes
• Collaborate with data analysts, data scientists, product teams, and business stakeholders to deliver trusted data assets
• Monitor and optimize pipeline performance, reliability, scalability, and cost efficiency
• Support cloud-based data platforms and data warehouse/lakehouse environments
• Implement data governance, security, lineage, and compliance standards across data assets
• Create technical documentation, design specifications, and operational procedures
• Provide technical guidance and knowledge sharing to junior engineers and team members
• Participate in code reviews and promote engineering best practices for development, testing, and deployment
• Troubleshoot production issues, perform root-cause analysis, and implement sustainable solutions
• Contribute to automation, CI/CD processes, and continuous improvement initiatives across the data ecosystem