Lead / Sr Data Engineer- Chennai & Remote

Teamplus Staffing Solution; Pune District, Chennai District, Bengaluru; Hybrid; INR 2,500,000 - 2,800,000; Full time

Job summary

Teamplus Staffing Solution is seeking a Lead / Senior Data Engineer to design and deliver scalable data platforms. You will guide data pipelines, warehousing, and big data architecture while mentoring junior engineers.

Expertise with PySpark, SQL, Hive, and Airflow is required, along with strong leadership. Remote/hybrid work options available in Chennai / office locations.

Qualifications

• Architecture & Design: design scalable, high-throughput data systems with governance and compliance.
• Lead & Technical Delivery: drive end-to-end delivery of data initiatives and robust designs.
• Pipeline Engineering: implement ETL/ELT pipelines using SQL, PySpark, Hive, Airflow.

Responsibilities

• Architect scalable data platforms and oversee end-to-end delivery.
• Translate business requirements into production-grade data designs.
• Lead and mentor junior engineers to ensure quality and best practices.
• Collaborate with stakeholders to align data strategy with goals.
• Leverage GenAI to accelerate pipeline generation and automation.

Skills

PySpark

SQL

Data Architecture

Hadoop

Hive

Airflow

Snowflake

Education

Bachelor's degree

Tools

AWS

GCP

Azure

Spark

Airflow

Snowflake

Job description

Lead / Senior Data Engineer- Chennai , Remote

Hi, We are having opening for Lead / Senior Data Engineer- Chennai , Remote

Job Summary

We are seeking a Lead / Senior Data Analytics Engineer to drive the design, development, and delivery of enterprise data platforms. You will act as a technical authority for data pipelines, data warehousing, and big data architecture while providing technical guidance to junior/mid-level team members. In addition to core data engineering expertise, experience leveraging AI / GenAI to accelerate data modeling, pipeline automation, and code generation is highly desirable.

Working Days: Monday Friday

Job Timing: 9AM 6PM

Position / DesignationLead / Senior Data Engineer Chennai , Remote

QualificationBachelor's degree in Computer Science, Information Technology, Engineering, or a related technical field

Years of Experience8 to 10 Years

Permanent / Contract (If contract, period ?)

Office / Remote / Hybrid 5th Floor, Neville Tower, Unit 6, 7 and 8, Ramanujan IT City, Rajiv Gandhi Salai, Taramani, Chennai 600113, Tamil Nadu, India

Number of post2

GenderMale / Female

Annual CTC / Salary25 to 28 L.p.a

Selection Process1- Total 3 Technical round 2- 2 rounds evaluation with LV (we can plan to take this together based on panel availability) & 1 with client

Job Role & Responsibility

Architecture & Design: Design and architect scalable, high-throughput, and reliable end-to-end data systems (databases, warehouses, and big data platforms) adhering to data governance, privacy, and compliance standards.

Lead & Technical Delivery: Drive the end-to-end technical delivery of complex data initiatives. Translate broad business requirements into robust, production-grade technical designs.

Pipeline Engineering: Lead the implementation and optimization of complex ETL/ELT data pipelines using SQL, PySpark, Hive, and Airflow across large-scale distributed environments.

Team Leadership & Mentorship: Provide technical leadership, code reviews, and architectural guidance to junior and mid-level data engineers to enforce best practices and quality standards.

Stakeholder Management: Collaborate with business leadership, product managers, and enterprise architects to align data strategies with overall organization goals.

AI & Innovation: Leverage AI / GenAI tools to streamline pipeline generation, query optimization, automated test suite generation, and metadata management.

Skills

• Primary Skills: Advanced PySpark, Advanced SQL, Data Architecture & Design, Big Data Ecosystem (Hadoop, HDFS, Hive), Airflow / Workflow Orchestration, Data Warehousing (Snowflake / Redshift / BigQuery).
• Secondary Skills: Enterprise Cloud Platforms (AWS / GCP / Azure), CI/CD & DevOps for Data Platforms, GenAI / AI-driven pipeline automation, Data Governance & Quality Frameworks, Streaming (Kafka / Spark Streaming).

Joining Date

Need Immediate to 15 Days