Tech SME -Bigdata Engineering - Databricks

Tiger Analytics; Chennai, Bengaluru, Hyderabad; On-site; INR 4,500,000 - 7,500,000; Full time

Job summary

Tiger Analytics is hiring a Senior Big Data Engineering Leader (Associate Director/Director) to drive data engineering strategy, architecture, and implementation for large-scale cloud data platforms on Azure. You will mentor teams, define roadmaps, and lead client engagements across data lake, lakehouse, DWH modernization, and data fabric initiatives.

You will work with cross-functional teams including analytics, data science, and business development to shape solutions, PoCs, and IP

Qualifications

• 15+ years of data engineering experience with 5+ years in Big Data and Azure ecosystem.
• Experience of leading & mentoring multiple high-performing data engineering teams.
• Good experience of working on proposals, defining solutions, roadmaps & plan, doing estimation etc.
• Strong experience of working with following technologies: Azure Databricks, Data Factory, Microsoft Fabric, Event Hub, Streaming Analytics, Cosmos DB, Unity Catalog and Purview.
• Must have: Strong Experience of working on Databricks ecosystem (PySpark, Notebooks, Unity Catalog, DLT, Workflows, SQL Warehouse etc.).
• Hadoop Ecosystem: Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop etc. Programming experience either in Python or Scala/Java. CI/CD with Git, Jenkins / Azure DevOps.
• Exposure to NoSQL Database and Data Modelling Good exposure to some of the emerging technologies like Gen AI, LLM etc.
• Experience with: Data lake / Lakehouse / data fabric / data mesh design and implementation. Designing/building large cloud-based Data Platform solutions (on Azure).
• Experience of building solutions to support BI and Data Science teams in consuming the data in a secure and governed manner.

Responsibilities

• Provide client advisory on key engineering & architectural decisions across the full life cycle of big data engineering projects like Data Lake / Lakehouse implementation, DWH Modernization, Data Fabric implementation etc.
• Work with strategic clients to help define their data engineering roadmaps Identify new ways of leveraging technology to solve client engineering problems
• Track latest tech innovations and build relevant PoVs & PoCs to further our capabilities
• Identify opportunities for Tiger to build IP. Lead the development efforts
• Lead capability building initiatives as part of our Innovation Lab and L&D Academy

Skills

Data engineering leadership

Azure Databricks

Big data architecture

Python/Scala/Java

Education

B.Tech/B.E

Tools

Hadoop

Spark

Kafka

MongoDB

Cassandra

Job description

Tech SME -Bigdata Engineering - Databricks

Job Description

Tiger Analytics is global AI and analytics consulting firm. With data and technology at the core of our solutions, our tribe is solving problems that eventually impact the lives of millions globally. Our culture is modeled around expertise and respect with a team-first mindset. Headquartered in Silicon Valley, you'll find our delivery centers across the globe and offices in multiple cities across India, the US, the UK, Canada, and Singapore, including a substantial remote global workforce. We're Great Place to Work-Certified. Working at Tiger Analytics, you'll be at the heart of an AI revolution. You'll work with teams that push the boundaries of what is possible and build solutions that energize and inspire.

• 15+ years of data engineering experience with 5+ years in the Big Data and Azure ecosystem.
• Experience of leading & mentoring multiple high-performing data engineering teams.
• Good experience of working on proposals, defining solutions, roadmaps & plan, doing estimation etc.
• Strong experience of working with following technologies:
• Azure ecosystem - Azure Databricks, Data Factory, Microsoft Fabric, Event Hub, Streaming Analytics, Cosmos DB, Unity Catalog and Purview.
• Must have: Strong Experience of working on Databricks ecosystem (PySpark, Notebooks, Unity Catalog, DLT, Workflows, SQL Warehouse etc.).
• Hadoop Ecosystem: Hadoop, Spark, Kafka, Hive, NoSQL - HBase / MongoDB / Cassandra, Impala, Sqoop etc. Programming experience either in Python or Scala/Java. CI/CD with Git, Jenkins / Azure DevOps.
• Exposure to NoSQL Database and Data Modelling Good exposure to some of the emerging technologies like Gen AI, LLM etc.
• Experience with: Data lake / Lakehouse / data fabric / data mesh design and implementation. Designing/building large cloud-based Data Platform solutions (on Azure).
• Experience of building solutions to support BI and Data Science teams in consuming the data in a secure and governed manner.

B.Tech/B.E from reputed institute preferred

You are important to us, lets stay connected! Every individual comes with a different set of skills and qualities so even if you don't tick all the boxes for the role today, we urge you to apply as there might be a suitable/unique role for you tomorrow. We are an equal opportunity employer. Our diverse and inclusive culture and values guide us to listen, trust, respect, and encourage people to grow the way they desire.

Note: The designation will be commensurate with expertise and experience. Compensation packages are among the best in the industry.

Mandatory Skills

Role

Job Title: Associate Director/Director - Big Data Engineering

Curious about the role? What your typical day would look like?

As a Big Data Engineering Leader, you will work with key leaders across the organization - tech consulting, analytics consulting, data science, data engineering, and business development to advance the company’s capabilities and positioning. On a typical day you might,

• Provide client advisory on key engineering & architectural decisions across the full life cycle of big data engineering projects like Data Lake / Lakehouse implementation, DWH Modernization, Data Fabric implementation etc.
• Work with strategic clients to help define their data engineering roadmaps Identify new ways of leveraging technology to solve client engineering problems
• Track latest tech innovations and build relevant PoVs & PoCs to further our capabilities
• Identify opportunities for Tiger to build IP. Lead the development efforts
• Lead capability building initiatives as part of our Innovation Lab and L&D Academy