Lead Data Engineer

Kanerika Inc; Hyderabad; On-site; INR 3,000,000 - 5,200,000; Full time

Job summary

Kanerika Inc. is seeking a Data Engineer Lead with 8+ years of experience to design and implement modern data platforms, ETL pipelines, and cloud analytics solutions in Hyderabad. You will lead data architecture initiatives and collaborate with business and analytics teams.

The role emphasizes Microsoft Fabric, Databricks, Snowflake, SQL and Python/Scala, and requires strong governance, security, and CI/CD practices.

Qualifications

• 8+ years in data engineering or data platform development, with 2–3 years in lead/architect role.
• Strong hands-on experience with Microsoft Fabric, Databricks, and Snowflake.
• Proficient in SQL and Python/Scala with cloud data services (Azure/AWS/GCP).

Responsibilities

• Lead design and implementation of modern data pipelines and data models.
• Architect and optimize data lake/warehouse solutions using Fabric, Databricks, or Snowflake.
• Enable analytics via Power BI and other visualization tools.
• Collaborate with data scientists and analysts to deliver high‑performance data solutions.
• Implement data governance, data quality, and security practices.
• Mentor junior engineers and establish coding standards.
• Evaluate new technologies to continuously improve the data ecosystem.

Skills

SQL

Python/Scala

Power BI

Education

Bachelor's degree in computer science, Information Technology, Engineering, or a related field

Bachelor’s/Master’s degree in Computer Science, Information Technology, Engineering, or related field

Tools

Microsoft Fabric

Databricks

Snowflake

Job description

We are looking for a Data Engineer Lead with 8+ years of experience in designing and implementing modern data platforms, ETL/ELT pipelines, and cloud-based analytics solutions. The role requires strong expertise in Microsoft Fabric, Databricks, Snowflake, and Power BI, along with proficiency in SQL and Python/Scala. The candidate will lead data architecture initiatives, optimize data lake and warehouse solutions, enforce data governance and security standards, and collaborate with business and analytics teams to deliver scalable, high-performance data solutions.

What You Will Do:

Following are high level responsibilities that you will play but not limited to:

• Lead the design, development, and implementation of modern data pipelines, data models, and ETL/ELT processes.
• Architect and optimize data lake and warehouse solutions using Microsoft Fabric, Databricks, or Snowflake.
• Enable business analytics and self-service reporting through Power BI and other visualization tools.
• Collaborate with data scientists, analysts, and business users to deliver reliable and high-performance data solutions.
• Implement and enforce best practices for data governance, data quality, and security.
• Mentor and guide junior data engineers; establish coding and design standards.
• Evaluate emerging technologies and tools to continuously improve the data ecosystem.

Required Qualifications:

• Bachelor's degree in computer science, Information Technology, Engineering, or a related field.
• Bachelor’s/Master’s degree in Computer Science, Information Technology, Engineering, or related field.
• 8+ years of experience in data engineering or data platform development, with at least 2–3 years in a lead or architect role.
• Strong hands-on experience in one or more of the following:
• Microsoft Fabric (Data Factory, Lakehouse, Data Warehouse)
• Snowflake (Data Warehousing, Snow Pipe, Performance Optimization)
• Power BI (Data Modeling, DAX, Report Development)
• Proficiency in SQL and programming languages like Python or Scala.
• Experience with Azure, AWS, or GCP cloud data services.
• Solid understanding of data modeling, data governance, security, and CI/CD practices.

Preferred Qualifications:

• Familiarity with data modeling techniques and practices for Power BI.
• Knowledge of Azure Databricks or other data processing frameworks.
• Knowledge of Microsoft Fabric or other Cloud Platforms.