Data Engineer/Lead

KBD Talent Forge India Pvt Ltd; Chennai District; On-site; INR 2,000,000 - 3,000,000; Full time

Job summary

KBD Talent Forge India Pvt Ltd is looking for a Lead Data Engineer in Chennai, Tamil Nadu to design and build scalable data infrastructure for enterprise-grade platforms. You will lead a team of data engineers and work closely with data scientists and business stakeholders to drive data architecture that supports analytics and AI/ML.

The ideal candidate should have 10 to 18 years of experience and expertise in Python, SQL, Spark, and cloud solutions. A solid educational background in computer science or related fields is required.

Qualifications

• 10 to 18 Years of experience in data engineering.
• Strong experience in scalable data architectures.
• Expertise in building ETL/ELT workflows.

Responsibilities

• Lead design and development of scalable data pipelines.
• Architect end-to-end data platforms.
• Build and optimize ETL/ELT workflows.
• Design cloud-native data solutions on AWS/Azure/GCP.
• Implement data governance, quality, and security standards.
• Manage streaming data pipelines using Kafka.
• Monitor, troubleshoot, and optimize data systems.
• Lead and mentor a team of data engineers.

Skills

Python

SQL

Apache Spark

Hadoop

Kafka

Airflow

Databricks

DevOps tools (Docker, Kubernetes)

BI tools (Power BI, Tableau)

Education

B.E / B.Tech / M.Tech / MCA / M.Sc (Computer Science / IT / Data Science / Statistics)

Job description

Job Description

Data Engineer Lead to design, build, and manage scalable data infrastructure and pipelines for enterprise-grade data platforms across cloud and big data ecosystems.

The Ideal Candidate Will Lead a Team Of Data Engineers And Drive End-to-end Data Architecture, Ensuring High-performance, Secure, And Reliable Data Solutions That Support Analytics, AI/ML, And Business Intelligence.

Responsibilities

• Lead design and development of scalable data pipelines and data engineering solutions.
• Architect and implement end-to-end data platforms (batch and real-time processing).
• Build and optimize ETL/ELT workflows using modern data engineering tools.
• Design cloud-native data solutions on AWS / Azure / GCP.
• Implement data governance, data quality, and data security standards.
• Collaborate with Data Scientists, Analysts, and Business stakeholders.
• Manage streaming data pipelines using Kafka / real-time ingestion tools.
• Monitor, troubleshoot, and optimize data systems for performance and scalability.
• Lead and mentor a team of data engineers.

Experience

• 10 to 18 Years

Required Skills

• Strong experience in Python, SQL, and distributed data systems.
• Expertise in Apache Spark, Hadoop, Kafka, Airflow, Databricks.
• Knowledge of DevOps tools (Docker, Kubernetes, CI/CD).
• Familiarity with BI tools (Power BI / Tableau).

Education

• B.E / B.Tech / M.Tech / MCA / M.Sc (Computer Science / IT / Data Science / Statistics)