Data Engineer

Metlife; Pune District; Hybrid; INR 900,000 - 1,500,000; Full time

Job summary

Metlife is seeking a Data Engineer to design, build, and operate scalable data pipelines and curated datasets powering analytics, reporting, and data products. You will work with modern cloud and data engineering tools, applying best practices around quality, security, and performance.

Responsibilities cover batch and streaming ETL, data ingestion from APIs and databases, data modeling, data quality checks, and collaboration with analysts and engineers.

Qualifications

• Bachelor of Computer Science or equivalent.
• Experience with SQL, Python, Azure cloud services, and data modelling.
• Experience building data pipelines and dashboards.

Responsibilities

• Build and maintain reliable, scalable data pipelines and curated datasets for analytics and reporting.
• Develop and maintain batch and streaming ETL/ELT pipelines.
• Ingest data from internal systems and external sources (APIs, files, databases).
• Transform data into a SCV-specific unified data model.
• Model and curate datasets for analytics (dimensional models, gold tables, semantic layer inputs).
• Perform data quality checks, monitoring, and alerting.
• Collaborate with analysts, product owners, and engineers to meet data needs.
• Contribute to documentation, data dictionaries, and runbooks.
• Participate in code reviews and follow CI/CD standards.
• Troubleshoot pipeline failures and support incident resolution.
• Follow data governance and security policies (PII handling, access control, retention).

Skills

SQL

Python

Azure

ETL/ELT pipelines

Data modelling

Data quality

CI/CD

Git

Stakeholder management

Problem-solving

Teamwork

Education

Bachelor of Computer Science

Tools

Databricks

Synapse

Terraform

Job description

Key Responsibilities:

• As a Data Engineer, youll help build and maintain reliable, scalable data pipelines and curated datasets that power analytics, reporting, and data products. You'll work with modern cloud and data engineering tools, learning best practices around data quality, security, and performance.
• Assist in building and maintaining batch and/or streaming ETL/ELT pipelines.
• Develop and support data ingestion from internal systems and external sources (APIs, files, databases including structure, semi-structured or unstructured data).
• Develop notebook to transform curated data into SCV specific unified data model
• Help model and curate datasets for analytics (dimensional models, curated "gold" tables, semantic layer inputs).
• Support data quality checks, monitoring, and alerting (validation rules, reconciliation).
• Collaborate with analysts, product owners, and engineers to understand data needs and deliver datasets.
• Contribute to documentation, data dictionaries, and runbooks.
• Participate in code reviews and follow engineering standards (naming, testing, CI/CD).
• Troubleshoot pipeline failures and support incident resolution with guidance from senior engineers.
• Follow data governance and security policies (PII handling, access control, retention).

Education:

• Bachelor of Computer Science or equivalent.

Technical Stack:

• SQL (DDL, DML, joins, aggregations, stored procedure, window functions basics)
• Programming (Python preferred; Java/Scala acceptable)
• Data concepts (schemas, structured/unstructured data, basic modelling)
• Understanding of software fundamentals: version control (Git), debugging, testing basics.
• Exposure to Azure cloud platform, especially:
• Data storage (Data Lake, blob/object storage)
• Compute (Spark/Databricks/Synapse)
• Event hub/Azure Stream Analytics
• Familiarity with orchestration tools (Synapse and ADF pipeline)
• Understanding of data modelling (star schema, slowly changing dimensions).
• Knowledge of DevOps basics: CI/CD pipelines, IaC (Terraform).
• Any internship/project experience building pipelines or dashboards.

Soft Skills:

• Excellent problem-solving, communication, and stakeholder management skills.
• Ability to balance technical innovation with business value delivery.
• Business acumen: A level-headed, clear communicator to gain detailed level of understanding of organizational business requirements and business dynamics.
• Self-Motivated and able to work independently.
• Attention to detail
• Collaborative
• Team Player
• Decisive
• Supportive
• Passionate
• Professional
• Accountable