Data Engineer

Careerwise; Bengaluru; Híbrido; INR 4 200 000 - 6 400 000; Tempo integral

Resumo da oferta

Careerwise is seeking a Senior Microsoft Fabric Data Engineer (L3) in Bengaluru. This hands-on role focuses on designing, developing and delivering scalable data solutions using Microsoft Fabric and Azure technologies.

You will own data engineering delivery, troubleshoot complex issues and optimize pipelines for performance and reliability. You will collaborate with data architects, analytics teams and business stakeholders to build robust platforms supporting BI, analytics, AI and enterprise

Qualificações

• 7+ years of overall Data Engineering experience with hands-on Microsoft Fabric projects.
• Demonstrable hands-on experience delivering Microsoft Fabric solutions in real projects.
• Ability to own data engineering delivery from design to production support.
• Experience working in Agile delivery environments.

Responsabilidades

• Design, develop and maintain production-grade data pipelines and data products using Microsoft Fabric.
• Build scalable data ingestion, transformation and orchestration solutions using Fabric Data Factory, notebooks and other Fabric capabilities.
• Implement Lakehouse and Warehouse solutions using appropriate data engineering patterns.
• Design and implement Medallion Architecture (Bronze, Silver and Gold) for structured and semi-structured data processing.
• Develop robust ETL/ELT pipelines, incremental data loads and data transformation frameworks.
• Write and optimise SQL and Python/PySpark code to process and transform data efficiently.
• Troubleshoot pipeline failures, data quality issues, performance bottlenecks and production incidents.
• Implement data validation, monitoring, logging, error handling and recovery mechanisms.
• Apply data governance, security, data lineage and metadata management practices.
• Contribute to CI/CD, Git integration, deployment automation and release management using Azure DevOps or equivalent tools.
• Ensure engineering solutions follow established architectural standards, coding practices and quality guidelines.
• Collaborate with architects, product owners and stakeholders to translate business requirements into technical solutions.
• Contribute to technical design discussions, code reviews and continuous improvement initiatives.

Conhecimentos

Microsoft Fabric Data Engineering

Fabric Lakehouse

Data Factory

Fabric Notebooks

OneLake

Fabric Warehouse

Delta Tables

SQL

Python

PySpark

ETL/ELT

Azure Data Platform

Git/CI/CD

Azure DevOps

Ferramentas

Azure DevOps

OneLake

Fabric Data Factory

Fabric Notebooks

Delta Tables

Descrição da oferta de emprego

Job Description:

Senior Microsoft Fabric Data Engineer (L3)

Work Model:

Hybrid – 2 days onsite per week

Experience:

7+ years in data engineering, with strong hands‑on Microsoft Fabric project experience

About the Role

We are looking for an experienced Senior Microsoft Fabric Data Engineer to design, develop and deliver scalable enterprise data solutions using Microsoft Fabric and Azure technologies.

This role requires a strong hands‑on engineer who can independently own data engineering delivery, make technical implementation decisions, troubleshoot complex issues and optimise data pipelines for performance, reliability and scalability.

You will work closely with data architects, analytics teams and business stakeholders to develop robust data platforms that support business intelligence, advanced analytics, AI and enterprise reporting.

This is a hands‑on engineering role, not a Power BI reporting or platform administration position.

Key Responsibilities

• Design, develop and maintain production‑grade data pipelines and data products using Microsoft Fabric.
• Build scalable data ingestion, transformation and orchestration solutions using Fabric Data Factory, notebooks and other relevant Fabric capabilities.
• Implement Lakehouse and Warehouse solutions using appropriate data engineering patterns.
• Design and implement Medallion Architecture (Bronze, Silver and Gold) for structured and semi‑structured data processing.
• Develop robust ETL/ELT pipelines, incremental data loads and data transformation frameworks.
• Write and optimise SQL and Python/PySpark code to process and transform data efficiently.
• Troubleshoot pipeline failures, data quality issues, performance bottlenecks and production incidents.
• Implement data validation, monitoring, logging, error handling and recovery mechanisms.
• Apply data governance, security, data lineage and metadata management practices.
• Contribute to CI/CD, Git integration, deployment automation and release management using Azure DevOps or equivalent tools.
• Ensure engineering solutions follow established architectural standards, coding practices and quality guidelines.
• Collaborate with architects, product owners and stakeholders to translate business requirements into technical solutions.
• Contribute to technical design discussions, code reviews and continuous improvement initiatives.

Essential Technical Skills

• Strong hands‑on experience delivering solutions using Microsoft Fabric Data Engineering capabilities.
• Practical experience with Microsoft Fabric Lakehouse, Data Factory, notebooks and data pipelines.
• Experience with OneLake, Fabric Warehouse and Delta tables where relevant to project requirements.
• Strong SQL skills and experience with data modelling and query optimisation.
• Proficiency in Python and/or PySpark for data engineering development.
• Strong understanding of ETL/ELT, data ingestion, transformation and orchestration.
• Experience implementing incremental processing, data quality checks and reliable pipeline execution.
• Experience working with Azure data platform services.
• Understanding of Git, CI/CD, Azure DevOps and deployment practices.
• Knowledge of data security, governance, monitoring and observability.

Experience and Seniority Requirements

• Ideally 7+ years of overall Data Engineering experience.
• Demonstrable hands‑on experience delivering Microsoft Fabric solutions in real projects.
• Experience taking ownership of data engineering solutions from design through development, deployment and production support.
• Ability to independently investigate technical problems and recommend appropriate solutions.
• Experience working in Agile delivery environments.
• Strong communication skills and the ability to collaborate with technical and non‑technical stakeholders.

What We Are Looking For

The ideal candidate will be able to explain the architecture of a Microsoft Fabric solution they have personally implemented, including data ingestion, transformations, storage, orchestration, deployment and production support.

We are particularly interested in engineers who have built and optimised real‑world Fabric solutions rather than candidates whose exposure is limited to certification, training, basic administration or Power BI reporting.