Lead /Sr. Data Engineer - Rajiv Gandhi SalaiTaramani, Chennai

Teamplus Staffing Solution; Chennai District; Hybrid; INR 2,800,000 - 3,200,000; Full time

Job summary

Teamplus Staffing Solution is looking for a Lead / Senior Data Engineer to drive design, development, and delivery of enterprise data platforms in a hybrid role in Chennai. You will lead data pipelines, warehousing, and big data architectures while guiding junior engineers.

AI/GenAI experience is highly desirable. The position expects 6–9 years of experience, a CS/IT/Engineering degree, and a salary budget up to 30 L p.a.

Qualifications

• Bachelor's degree in CS/IT/Engineering or related field.
• 6–9 years of experience in data engineering.
• Experience with AI/GenAI for data modeling and automation is desirable.

Responsibilities

• Architecture & Design: Design scalable end-to-end data systems with governance and compliance.
• Lead & Technical Delivery: Drive end-to-end delivery of complex data initiatives.
• Pipeline Engineering: Build/optimize ETL/ELT pipelines using SQL, PySpark, Hive and Airflow.
• Team Leadership & Mentorship: Provide technical guidance and code reviews to engineers.
• Stakeholder Management: Align data strategies with business goals.
• AI & Innovation: Use GenAI tools to automate pipelines and metadata tasks.

Skills

PySpark expertise

SQL expertise

Data architecture

Big Data ecosystem

Airflow

Data warehousing

Education

Bachelor's degree in CS/IT/Engineering

Tools

AWS

GCP

Azure

CI/CD for Data Platforms

GenAI tools

Kafka

Spark Streaming

Job description

Hi,

We are having opening for Lead / Sr. Data Engineer - Hybrid

Job Summary

We are seeking a Lead / Senior Data Analytics Engineer to drive the design, development, and delivery of enterprise data platforms. You will act as a technical authority for data pipelines, data warehousing, and big data architecture while providing technical guidance to junior/mid-level team members. In addition to core data engineering expertise, experience leveraging AI / GenAI to accelerate data modeling, pipeline automation, and code generation is highly desirable.

Working Days & Job Timing

Working Days: Monday Friday

Job Timing: 9AM 6PM

Position Details

• Position / Designation: Lead / Senior Data Engineer - Hybrid
• Qualification: Bachelor's degree in Computer Science, Information Technology, Engineering, or a related technical field
• Years of Experience: 6 to 9 Years
• Permanent / Contract (If contract, period ?): Permanent Full Time
• Office / Remote / Hybrid: Rajiv Gandhi SalaiTaramani, Chennai
• Number of post: 1
• Gender: Male / Female
• Annual CTC / Salary: Budget up to 30 L p.a.
• Selection Process:
  • 1- Total 3 Technical round
  • 2- 2 rounds evaluation with LV (we can plan to take this together based on panel availability) & 1 with client

Job Role & Responsibility

• Architecture & Design: Design and architect scalable, high-throughput, and reliable end-to-end data systems (databases, warehouses, and big data platforms) adhering to data governance, privacy, and compliance standards.
• Lead & Technical Delivery: Drive the end-to-end technical delivery of complex data initiatives. Translate broad business requirements into robust, production-grade technical designs.
• Pipeline Engineering: Lead the implementation and optimization of complex ETL/ELT data pipelines using SQL, PySpark, Hive, and Airflow across large-scale distributed environments.
• Team Leadership & Mentorship: Provide technical leadership, code reviews, and architectural guidance to junior and mid-level data engineers to enforce best practices and quality standards.
• Stakeholder Management: Collaborate with business leadership, product managers, and enterprise architects to align data strategies with overall organization goals.
• AI & Innovation: Leverage AI / GenAI tools to streamline pipeline generation, query optimization, automated test suite generation, and metadata management.

Skills

• Primary Skills: Advanced PySpark, Advanced SQL, Data Architecture & Design, Big Data Ecosystem (Hadoop, HDFS, Hive), Airflow / Workflow Orchestration, Data Warehousing (Snowflake / Redshift / BigQuery).
• Secondary Skills: Enterprise Cloud Platforms (AWS / GCP / Azure), CI/CD & DevOps for Data Platforms, GenAI / AI-driven pipeline automation, Data Governance & Quality Frameworks, Streaming (Kafka / Spark Streaming).

Joining Date

Need Immediate to 1 Month