Senior Data Engineer

SourcingXPress; Bengaluru; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

A data solutions firm is seeking a Senior Data Platform Engineer in Bengaluru to own the design and delivery of a Databricks-first data platform. The role involves building high-performance data pipelines and ensuring best engineering practices. Candidates should have over 9 years of experience, specific Databricks certifications, and strong skills in Python, SQL, and Azure tools. You'll collaborate closely with analysts and stakeholders to create reliable analytics products, fostering a robust data culture.

Qualifications

• 9+ years of hands-on experience in Data Engineering roles.
• Deep expertise in Databricks, Delta Lake, Unity Catalog, and related technologies.
• Strong understanding of Data Warehousing concepts and dimensional modeling.

Responsibilities

• Design and deliver a Databricks-first data platform.
• Build high-performance data pipelines and architect scalable Lakehouse solutions.
• Work with business analysts and stakeholders on production-grade analytics products.

Skills

Databricks expertise

Advanced PySpark skills

Strong SQL skills

Azure Data Factory experience

Azure DevOps CI/CD experience

Real-time data processing frameworks

Education

Databricks Certified Data Engineer Professional or Associate

Microsoft Certified: Azure Data Engineer Associate

Tools

Databricks

Azure Synapse Analytics

Terraform

Job description

Overview

We are assisting our client with their search for a Senior Data Platform Engineer (Senior Databricks Engineer) to become a cornerstone of their Data & Analytics team. In this role, you will own the design and delivery of their Databricks-first data platform — building high-performance data pipelines, architecting scalable Lakehouse solutions, and championing engineering best practices across the team. You will work closely with business analysts, a data modeler and business stakeholders to turn raw data into reliable, production-grade analytics products.

Mandatory Requirement

• Databricks Certified Data Engineer Professional or Associate (mandatory).
• Microsoft Certified: Azure Data Engineer Associate (mandatory).

Required Skills And Qualifications

• 9+ years of hands-on experience in Data Engineering roles.
• Deep expertise in Databricks — Delta Lake, Unity Catalog, Delta Live Tables, Workflows, Clusters.
• Advanced PySpark and Python skills for large-scale distributed data processing.
• Strong SQL skills: query authoring, performance tuning, and data modeling.
• Experience with Azure Data Factory, ADLS Gen2, Azure Synapse Analytics.
• Hands-on experience with Azure DevOps CI/CD and Infrastructure as Code (Terraform or Bicep).
• Strong understanding of Data Warehousing concepts, dimensional modeling, and Data Lakehouse patterns (Medallion architecture).
• Experience with Structured Streaming or other real-time data processing frameworks.

Good to have

• Experience with Microsoft Purview for data cataloguing and governance.
• Familiarity with dbt (data build tool) for SQL-based transformation workflows.
• Knowledge of MLflow and Databricks Feature Store for ML engineering integration.
• Exposure to Databricks Asset Bundles (DABs) for project packaging and deployment.
• Experience with Azure Function Apps, Logic Apps, or Event Hubs for event-driven architectures.
• Background in data mesh or data product thinking.