Lead Data Engineer

Kanerika Inc; Indore District; On-site; INR 3,500,000 - 7,000,000; Full time

Job summary

Kanerika Inc is seeking a Lead Data Engineer to build scalable cloud data platforms and modern ETL/ELT pipelines using Microsoft Fabric, Databricks, or Snowflake.

You will design Lakehouse/Data Warehouse solutions, enable analytics, and lead data engineering best practices while mentoring junior engineers. Strong PySpark, SQL, Python/Scala, and cloud experience are required.

Qualifications

• Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
• Bachelor’s/Master’s degree in Computer Science, Information Technology, Engineering, or related field.
• 8+ years of experience in data engineering or data platform development, with at least 2-3 years in a lead or architect role.
• Strong hands-on experience in Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse) and Snowflake.
• Proficiency in SQL and programming languages like Python or Scala.
• Experience with Azure, AWS, or GCP cloud data services.

Responsibilities

• Lead the design, development, and implementation of modern data pipelines, data models, and ETL/ELT processes.
• Architect and optimize data lake and warehouse solutions using Microsoft Fabric, Databricks, or Snowflake.
• Enable business analytics and self-service reporting through Power BI and other visualization tools.
• Collaborate with data scientists, analysts, and business users to deliver reliable and high-performance data solutions.
• Implement and enforce best practices for data governance, data quality, and security.
• Mentor and guide junior data engineers; establish coding and design standards.
• Evaluate emerging technologies and tools to continuously improve the data ecosystem.

Skills

Leadership

PySpark

SQL

Python/Scala

Cloud platforms

Data Modeling

Power BI

CI/CD

Education

Bachelor's degree in CS/IT/Engineering

Master's degree in CS/IT/Engineering

Tools

Microsoft Fabric

Databricks

Snowflake

Power BI

Python

Scala

Job description

We are hiring a Lead Data Engineer to build scalable cloud data platforms and modern ETL/ELT pipelines using Microsoft Fabric, Databricks, or Snowflake. The role involves designing Lakehouse/Data Warehouse solutions, enabling analytics, and leading data engineering best practices. Strong experience in PySpark, SQL, Python/Scala, and cloud platforms is required.

What You Will Do:

Following are high level responsibilities that you will play but not limited to:

• Lead the design, development, and implementation of modern data pipelines, data models, and ETL/ELT processes.
• Architect and optimize data lake and warehouse solutions using Microsoft Fabric, Databricks, or Snowflake.
• Enable business analytics and self-service reporting through Power BI and other visualization tools.
• Collaborate with data scientists, analysts, and business users to deliver reliable and high-performance data solutions.
• Implement and enforce best practices for data governance, data quality, and security.
• Mentor and guide junior data engineers; establish coding and design standards.
• Evaluate emerging technologies and tools to continuously improve the data ecosystem.

Required Qualifications:

• Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
• Bachelor’s/Master’s degree in Computer Science, Information Technology, Engineering, or related field.
• 8+ years of experience in data engineering or data platform development, with at least 2‐3 years in a lead or architect role.
• Strong hands-on experience in one or more of the following:
• Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse)
• Snowflake (Data Warehousing, Snowpipe, Performance Optimization)
• Power BI (Data Modeling, DAX, Report Development)
• Proficiency in SQL and programming languages like Python or Scala.
• Experience with Azure, AWS, or GCP cloud data services.
• Solid understanding of data modeling, data governance, security, and CI/CD practices.

Preferred Qualifications:

• Familiarity with data modeling techniques and practices for Power BI.
• Knowledge of Azure Databricks or other data processing frameworks.
• Knowledge of Microsoft Fabric or other Cloud Platforms.