Databricks Data Engineer - DE/SDE

Tiger Analytics; Hyderabad, Chennai, Bengaluru; Hybrid; INR 1,500,000 - 3,000,000; Full time

Job summary

Tiger Analytics is seeking a data engineer to design and implement scalable data pipelines and data lakehouse architectures on Azure Databricks. You will work on complex data workflows, apply PySpark and Python to build analytics products, and ensure strong instrumentation and CI/CD practices.

The role requires collaboration with cross-functional teams and a focus on delivering measurable business outcomes.

Qualifications

• 3+ years of technical experience in data engineering.
• Hands-on Azure and Databricks delivering end-to-end Data Lakehouse solutions.
• Strong PySpark, Python, SQL and CI/CD skills.
• Experience with Azure-native services and data modeling.
• Exposure to LLM/Generative AI apps.

Responsibilities

• Design scalable data ingestion, quality, and transformation pipelines.
• Build end-to-end Data Lakehouse solutions on Azure Databricks.
• Develop robust logging, monitoring, and observability.
• Lead data workflows and mentor peers.
• Collaborate with cross-functional teams to deliver analytics.
• Implement CI/CD for data platforms using Azure DevOps.

Skills

Azure Databricks

PySpark

SQL

Python

Structured Streaming

Unity Catalog

Delta Live Tables

Data Modeling

CI/CD (Azure DevOps)

LLM/Generative AI

Education

Bachelor’s degree in Computer Science / IT

Tools

Azure Data Factory

ADLS Gen2

Azure SQL Database

Event Hub

Notebooks

Job description

JOB DESCRIPTION

Who we are

Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer fullstack

AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to

push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively. Our purpose

is to provide certainty to shape a better tomorrow.

Our team of 6000+ technologists and consultants are based in the US, Canada, the UK, India, Singapore and Australia, working closely

with clients across CPG, Retail, Insurance, BFS, Manufacturing, Life Sciences, and Healthcare. Many of our team leaders rank in Top

10 and 40 Under 40 lists, exemplifying our dedication to innovation and excellence.

We are a Great Place to Work-Certified (2022-24), recognized by analyst firms such as Forrester, Gartner, HFS, Everest, ISG and

others. We have been ranked among the Best’ and ‘Fastest Growing’ analytics firms lists by Inc., Financial Times, Economic Times

and Analytics India Magazine.

Curious about the role? What your typical day would look like?

Role Overview

We are seeking street-smart and technically strong Data Engineers who can take ownership of designing and developing cutting-edge

data and AI platforms using Azure-native technologies and Databricks. You will play a critical role in building scalable data pipelines,

modern data architectures, and intelligent analytics solutions.

Key Responsibilities

• Design and implement scalable, metadata-driven frameworks for data ingestion, quality, and transformation across both batch and streaming datasets.
• Develop and optimize end-to-end data pipelines to process structured and unstructured data, enabling the creation of analytical data products.
• Build robust exception handling, logging, and monitoring mechanisms for better observability and operational support.
• Take ownership of complex modules and lead the development of critical data workflows and components.
• Provide guidance to data engineers and peers on best practices.
• Collaborate with cross-functional teams—including business consultants, data architects, scientists, and application developers—to deliver impactful analytics solutions.

Expertise and Qualifications

• 3+ years of overall technical experience, with a minimum of 2 years of hands-on experience with Microsoft Azure and Databricks.
• Proven experience delivering at least one end-to-end Data Lakehouse solution on Azure Databricks using the Medallion Architecture.
• Strong working knowledge of the Databricks ecosystem, including: PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQL Warehouse.
• Advanced programming, unit testing, and debugging skills in Python and SQL.
• Hands-on experience with Azure-native services such as: Azure Data Factory, ADLS Gen2, Azure SQL Database, and Event Hub.
• Solid understanding of data modeling techniques, including both Dimensional and Third Normal Form (3NF) models.
• Exposure to developing LLM/Generative AI-powered applications.
• Must have excellent understanding of CI/CD workflows using Azure DevOps.
• Bonus: Knowledge of Azure infrastructure, including provisioning, networking, security, and governance.

Educational Background

Bachelor’s degree (B.E/B.Tech) in Computer Science, Information Technology, or a related field from a reputed institute

(preferred).