Senior Data Engineer

KANINI; Chennai District; On-site; INR 4,000,000 - 7,000,000; Full time

Benefits offered by this job

Award-winning Data Team

Growth opportunities

Cutting-edge tools

Leadership support

Job summary

KANINI is seeking a skilled Data Engineer to build scalable, high-performance data pipelines on Google Cloud Platform (GCP). The ideal candidate will have hands-on experience with BigQuery, Airflow, and cloud-based ETL workflows, and strong programming expertise in Python or Java.

We require 8+ years of experience, with location across India including Chennai, Pune, Coimbatore and Bangalore. Join a dynamic team focused on data engineering excellence and cutting-edge solutions.

Qualifications

• 8+ years of experience in data engineering or related field.
• Hands-on experience with Google Cloud Platform (GCP) services like BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Airflow (Composer).
• Proficiency in Python or Java for data processing and pipeline development.
• Experience designing end-to-end ETL/ELT pipelines for structured and unstructured data.
• Strong SQL skills and knowledge of data modeling, partitioning, clustering, and cost management.

Responsibilities

• Design, develop, and maintain scalable data pipelines and data lake solutions on GCP.
• Build and automate data ingestion and transformation workflows using Airflow and BigQuery.
• Ensure data quality, performance, and security across cloud environments.
• Collaborate with cross-functional teams to translate business needs into efficient data models.
• Optimize queries, manage schema evolution, and maintain high data availability.
• Implement data governance, version control, and CI/CD best practices.
• Monitor and troubleshoot data pipelines for continuous reliability and efficiency improvements.

Skills

GCP experience

BigQuery

Airflow/Composer

Python/Java

SQL & data modeling

ETL/ELT design

DevOps/CI-CD

Docker/Kubernetes

NoSQL (MongoDB/Firestore)

Tools

Airflow (Composer)

Git

Docker

Kubernetes

BigQuery

Job description

We are looking for a skilled Data Engineer with a strong background in building scalable, high-performance data pipelines on Google Cloud Platform (GCP).

The ideal candidate will have hands-on experience with BigQuery, Airflow, and cloud-based ETL workflows, along with solid programming expertise in Java or Python.

Experience: 8+ Years

Location: Chennai, Pune, Coimbatore and Bangalore

Primary Skills

• Google Cloud Platform (GCP): Hands-on experience with BigQuery, Cloud Storage, Dataflow, Pub/Sub, and Airflow (Composer).
• BigQuery: Strong SQL skills with expertise in query optimization, partitioning, clustering, and cost management.
• Airflow (Composer): Proven ability to build, schedule, and monitor ETL/ELT pipelines using Apache Airflow.
• Programming: Proficiency in Python or Java for data processing, automation, and pipeline development.
• ETL & Data Integration: Designing and implementing end-to-end ETL/ELT workflows for structured and unstructured data.
• Database Management: Strong command of SQL; working knowledge of NoSQL databases like MongoDB or Firestore.
• Version Control & DevOps: Experience with Git, CI/CD practices; familiarity with Docker/Kubernetes is a plus.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines and data lake solutions on GCP.
• Build and automate data ingestion and transformation workflows using Airflow and BigQuery.
• Ensure data quality, performance, and security across all cloud environments.
• Collaborate with cross-functional teams to translate business needs into efficient data models.
• Optimize queries, manage schema evolution, and maintain high data availability.
• Implement data governance, version control, and CI/CD best practices.
• Monitor and troubleshoot data pipelines for continuous reliability and efficiency improvements.

Why Join KANINI?

• Join KANINI’s award-winning Data Engineering Team, recognized as the "Outstanding Data Engineering Team" at DES 2025
• Work on real-world problemsat the intersection of data, AI, and product development
• Be part of a collaborative, innovative, and growth-driven environment.
• Access to cutting-edge tools, leadership support, and continuous learning opportunities.