Senior Data Engineer

Tiger Analytics; Bengaluru; In loco; INR 1.200.000 - 2.400.000; Tempo pieno

Descrizione del lavoro

Tiger Analytics is seeking street-smart Data Engineers to design and develop cutting-edge data and AI platforms using Azure-native technologies and Databricks. You will build scalable data pipelines, modern data architectures, and intelligent analytics solutions from scratch.

Key responsibilities include end-to-end pipeline development, robust observability, and collaboration with cross-functional teams to deliver impactful analytics.

Competenze

• Strong data engineering capabilities with experience designing and building scalable data pipelines.
• Hands-on with Databricks, PySpark, SQL, and cloud-native data services on Azure.
• Experience in batch and streaming data processing, data quality and transformation.
• Proficiency in CI/CD workflows using Azure DevOps.

Mansioni

• Design scalable data ingestion, quality, and transformation pipelines across batch and streaming datasets.
• Develop end-to-end data pipelines to enable analytical data products.
• Build robust logging, monitoring, and observability mechanisms.
• Lead development of complex data workflows and components.
• Leverage Databricks ecosystem: PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, SQL Warehouse.
• Use Azure-native services: Data Factory, ADLS Gen2, Azure SQL Database, Event Hub.
• Code in Python, PySpark, and SQL with unit tests and debugging.
• Expose to LLM/Generative AI powered applications.
• Follow CI/CD workflows using Azure DevOps.
• Share best practices with data engineers and cross-functional teams.

Conoscenze

Python

PySpark

SQL

Databricks

Azure Data Factory

ADLS Gen2

Azure SQL Database

Event Hub

Unity Catalog

Delta Live Tables

Structured Streaming

Notebooks

SQL Warehouse

Azure DevOps

LLM/Generative AI

CI/CD

Data pipelines

Strumenti

Databricks

PySpark

Azure Data Factory

ADLS Gen2

Azure SQL Database

Event Hub

Unity Catalog

Delta Live Tables

SQL Warehouse

Notebooks

Azure DevOps

Descrizione del lavoro

Tiger Analytics is a global leader in AI and analytics, helping Fortune 1000 companies solve their toughest challenges. We offer full stack AI and analytics services & solutions to empower businesses to achieve real outcomes and value at scale. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively. Our purpose is to provide certainty to shape a better tomorrow. Our team of 6000+ technologists and consultants are based in the US, Canada, the UK, India, Singapore and Australia, working closely with clients across CPG, Retail, Insurance, BFS, Manufacturing, Life Sciences, and Healthcare.

Many of our team leaders rank in Top 10 and 40 Under 40 lists, exemplifying our dedication to innovation and excellence. We are a Great Place to Work-Certified? (2022-24), recognized by analyst firms such as Forrester, Gartner, HFS, Everest, ISG and others. We have been ranked among the Best and Fastest Growing analytics firms lists by Inc., Financial Times, Economic Times and Analytics India Magazine. Curious about the role? What your typical day would look like?

We are seeking street-smart and technically strong Data Engineers who can take ownership of designing and developing cutting-edge data and AI platforms using Azure-native technologies and Databricks.

You will play a critical role in building scalable data pipelines, modern data architectures, and intelligent analytics solutions.

Key Responsibilities:

• Design and implement scalable, metadata-driven frameworks for data ingestion, quality, and transformation across both batch and streaming datasets.
• Develop and optimize end-to-end data pipelines to process structured and unstructured data, enabling the creation of analytical data products.
• Build robust exception handling, logging, and monitoring mechanisms for better observability and operational support.
• Take ownership of complex modules and lead the development of critical data workflows and components.
• Strong working knowledge of the Databricks ecosystem, including: PySpark, Notebooks, Structured Streaming, Unity Catalog, Delta Live Tables, Workflows, and SQL Warehouse.
• Hands-on experience with Azure-native services such as: Azure Data Factory, ADLS Gen2, Azure SQL Database, and Event Hub.
• Advanced programming, unit testing, and debugging skills in Python, PySpark and SQL.
• Exposure to developing LLM/Generative AI-powered applications.
• Must have excellent understanding of CI/CD workflows using Azure DevOps.
• Bonus: Knowledge of Azure infrastructure, including provisioning, networking, security, and governance.
• Provide guidance to data engineers and peers on best practices.
• Collaborate with cross-functional teams including business consultants, data architects, scientists, and application developers to deliver impactful analytics solutions.

Locations Open: Bengaluru / Chennai / Hyderabad