Lead Data Engineer

Keka Technologies Private Limited; Pune District; On-site; INR 4,500,000 - 7,000,000; Full time

Job summary

Keka Technologies Private Limited in Pune is seeking a senior data engineering lead to head end-to-end design, development, and delivery of cloud-based data pipelines, translating business requirements into scalable data solutions.

The role requires 8+ years in data engineering, strong Python/SQL/Spark skills across Azure/AWS/GCP, and experience with DataLake, Delta Lake, and Lakehouse architectures, plus governance and observability tooling.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
• 8+ years of experience in data engineering with proven leadership in designing cloud-native data systems.
• Strong expertise in Python, SQL, Apache Spark, and at least one cloud platform (Azure, AWS, or GCP).
• Experience with Big Data, DataLake, DeltaLake, and Lakehouse architectures
• Proficient in PostgreSQL, Redshift, Snowflake, and NoSQL databases.
• Ability to recommend and implement scalable data pipelines
• Cloud certification preferred; Databricks, Snowflake, or Terraform experience
• Familiarity with data governance, lineage, and observability tools.
• Strong collaboration skills and ability to influence data-driven decisions across teams.

Responsibilities

• Lead end-to-end design, development, and delivery of cloud-based data pipelines.
• Collaborate with architects and stakeholders to translate business requirements into technical data solutions.
• Ensure scalability, reliability, and performance of data systems across environments.
• Provide mentorship and technical leadership to data engineering teams.
• Define and enforce best practices for data modeling, transformation, and governance.
• Optimize data ingestion and transformation frameworks for efficiency and cost management.
• Contribute to data architecture design and review sessions across projects.

Skills

Data leadership

Mentorship

Collaboration

Data governance

Data modeling

Education

Bachelor’s or Master in CS/Eng

Tools

Python

SQL

Apache Spark

Azure

AWS

GCP

Delta Lake

Big Data

PostgreSQL

Redshift

Snowflake

Terraform

Databricks

Job description

Lead end-to-end design, development, and delivery of complex cloud-based data pipelines.

Collaborate with architects and stakeholders to translate business requirements into technical data solutions.

Ensure scalability, reliability, and performance of data systems across environments.

Provide mentorship and technical leadership to data engineering teams.

Define and enforce best practices for data modeling, transformation, and governance.

Optimizedata ingestion and transformation frameworks for efficiency and cost management.

Contribute to data architecture design and review sessions across projects.

Qualifications:

Bachelor’s orMaster’s degree in Computer Science, Engineering, or related field.

8+ years of experience in data engineering with proven leadership in designing cloud-native data systems.

Strongexpertisein Python, SQL, Apache Spark, and at least one cloud platform (Azure, AWS, or GCP).

Experience with Big Data,DataLake,DeltaLake, and Lakehouse architectures

Proficient in one or more database technologies (e.g.PostgreSQL, Redshift, Snowflake, and NoSQL databases).

Ability to recommend and implement scalable data pipelines

Preferred Qualifications:

Cloud certification (AWS, Azure, or GCP).

Experience with Databricks, Snowflake, or Terraform.

Familiarity with data governance, lineage, and observability tools.

Strong collaboration skills and ability to influence data-driven decisions across teams.