Sr. Data Engineer

Serendipity Corporate Services; Bengaluru; On-site; INR 1,400,000 - 2,400,000; Full time

Job summary

Serendipity Corporate Services seeks a data engineer to design, build and optimize scalable data platforms, including data warehouses and lakehouse architectures.

The role requires hands-on experience with modern ETL/ELT pipelines, SQL mastery, and knowledge of Microsoft Fabric, Delta Lake and OneLake concepts. Collaboration across teams and strong data quality practices are essential.

Qualifications

• Hands-on experience in designing and implementing data platforms, including data warehouses, lakehouse, and modern ETL/ELT pipelines.
• Proven ability to build, deploy, and troubleshoot highly reliable, distributed data pipelines with structured and unstructured data.
• Working knowledge of Microsoft Fabric (Pipelines, Dataflows Gen2, Notebooks, Lakehouse).
• Familiarity with Delta Lake / OneLake concepts and Medallion Architecture (Bronze/Silver/Gold).
• Solid understanding of data lakehouse patterns, semantic modeling, and AI/ML-ready data models.
• Strong SQL, relational and dimensional data modeling, and query tuning.

Responsibilities

• Design, build and optimize scalable data pipelines and platforms.
• Collaborate with cross-functional teams to deliver reliable data solutions.
• Lead data integration initiatives and ensure data quality across pipelines.

Skills

Data pipelines

SQL & data modeling

AI/ML-ready data models

Git & CI/CD

Communication & collaboration

Tools

Microsoft Fabric

Delta Lake

OneLake

Azure DevOps or GitHub Actions

Job description

• Hands-on experience in designing and implementing data platforms, including data warehouses, lakehouse, and modern ETL/ELT pipelines.
• Working knowledge of Microsoft Fabric (Pipelines, Dataflows Gen2, Notebooks, Lakehouse) is strongly preferred.
• Proven ability to build, deploy, and troubleshoot highly reliable, distributed data pipelines integrating structured and unstructured data from various internal systems and external sources.
• Working knowledge of the Medallion Architecture (Bronze/Silver/Gold) and Delta Lake / OneLake concepts; prior project experience implementing this pattern is highly desirable.
• Solid understanding of data lakehouse patterns and Delta Lake / OneLake concepts, with the ability to structure data models that are AI/ML-ready and support semantic modeling.
• Solid understanding of SQL, relational and dimensional data modeling, query tuning, and basic performance optimization.
• Familiarity with data quality concepts, including null/duplicate/schema-drift checks, basic SCD handling, and validation rules in transformation pipelines.
• Familiarity with Git, branching strategies, and CI/CD concepts in a data engineering context (Azure DevOps or GitHub Actions).
• Strong communication and collaboration skills, with the ability to articulate complex data engineering solutions to both technical and non-technical stakeholders, and to lead cross-functional initiatives.