Lead Data Engineer

Kanerika Inc; Hyderabad; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Kanerika Inc. is seeking a Data Engineer Lead with 8+ years of experience to design and implement modern data platforms and pipelines.

You will lead data architecture initiatives and optimize data lake/warehouse solutions across cloud environments, enabling analytics through Power BI and other tools. You will mentor junior engineers, establish coding standards, and collaborate with business and analytics teams to deliver scalable, high-performance data solutions.

Qualifications

• Bachelor's or higher in CS/IT/engineering
• 8+ years in data engineering with 2–3 years in lead/architect roles
• Hands-on with Microsoft Fabric, Databricks, Snowflake, and Power BI
• Proficient in SQL and Python or Scala
• Experience with cloud data services (Azure/AWS/GCP)

Responsibilities

• Design, develop, and implement modern data pipelines, data models, and ETL/ELT processes.
• Architect and optimize data lake and warehouse solutions using Microsoft Fabric, Databricks, or Snowflake.
• Enable business analytics and self-service reporting through Power BI and other visualization tools.
• Collaborate with data scientists, analysts, and business users to deliver reliable, high-performance data solutions.
• Implement and enforce data governance, data quality, and security practices.
• Mentor junior data engineers and establish coding and design standards.
• Evaluate emerging technologies to continually improve the data ecosystem.

Skills

Data engineering

Lead

SQL

Python

Scala

Databricks

Snowflake

Power BI

Microsoft Fabric

CI/CD

Education

Bachelor's degree

Master's degree in CS/IT/Engineering

Tools

Databricks

Snowflake

Power BI

Job description

We are looking for a Data Engineer Lead with 8+ years of experience in designing and implementing modern data platforms, ETL/ELT pipelines, and cloud-based analytics solutions. The role requires strong expertise in Microsoft Fabric, Databricks, Snowflake, and Power BI, along with proficiency in SQL and Python/Scala. The candidate will lead data architecture initiatives, optimize data lake and warehouse solutions, enforce data governance and security standards, and collaborate with business and analytics teams to deliver scalable, high-performance data solutions.

What You Will Do:

Following are high level responsibilities that you will play but not limited to:

• Lead the design, development, and implementation of modern data pipelines, data models, and ETL/ELT processes.
• Architect and optimize data lake and warehouse solutions using Microsoft Fabric, Databricks, or Snowflake.
• Enable business analytics and self-service reporting through Power BI and other visualization tools.
• Collaborate with data scientists, analysts, and business users to deliver reliable and high-performance data solutions.
• Implement and enforce best practices for data governance, data quality, and security.
• Mentor and guide junior data engineers; establish coding and design standards.
• Evaluate emerging technologies and tools to continuously improve the data ecosystem.

Required Qualifications:

• Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
• Bachelor’s/Master’s degree in Computer Science, Information Technology, Engineering, or related field.
• 8+ years of experience in data engineering or data platform development, with at least 2–3 years in a lead or architect role.
• Strong hands-on experience in one or more of the following:
• Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse)
• Snowflake (Data Warehousing, Snow Pipe, Performance Optimization)
• Power BI (Data Modeling, DAX, Report Development)
• Proficiency in SQL and programming languages like Python or Scala.
• Experience with Azure, AWS, or GCP cloud data services.
• Solid understanding of data modeling, data governance, security, and CI/CD practices.

Preferred Qualifications:

• Familiarity with data modeling techniques and practices for Power BI.
• Knowledge of Azure Databricks or other data processing frameworks.
• Knowledge of Microsoft Fabric or other Cloud Platforms.