Walkin Drive-19 Sep-Chennai -Pyspark Data Engineer

Tata Consultancy Services; Chennai District; On-site; INR 1,000,000 - 2,400,000; Full time

Job summary

Tata Consultancy Services invites applicants for a walk-in interview drive in Chennai. Candidates should have 4–15 years of experience and be proficient in PySpark, Spark SQL, and real-time data streaming with Kafka. Knowledge of Python, Java, or Scala and cloud platforms is essential.

Registration is between 9:30 and 12:30, with a focus on data engineering, distributed computing, and strong communication skills to collaborate across teams.

Qualifications

• 4–15 years of experience in data engineering or related roles.
• Strong with PySpark, Spark stack and Python/Java/Scala.
• Hands-on with cloud platforms and real-time data processing.

Responsibilities

• PySpark, Spark SQL and Python for data processing tasks.
• Design and implement data ingestion, transformation and storage pipelines.
• Work with cloud data platforms (AWS/Azure/GCP).
• Build DataFrames and streaming pipelines using Spark + Kafka.
• Collaborate across teams with clear communication.

Skills

PySpark

Spark SQL

Spark Streaming

Data processing

Cloud platforms

Python

Java/Scala

Multithreading

Communication

Tools

AWS

Azure

GCP

Job description

Inviting Application for Walkin Interview Drive-19 Sept-Chennai

Exp: 4-15 years

Registration Time: 9:30-12:30pm

Role & responsibilities

• PySpark: In-depth knowledge of PySpark, Apache Spark, and Python.
• Data Processing: Strong understanding of data processing concepts, including data ingestion, data transformation, and data storage.
• Cloud Experience: Experience with cloud-based data platforms, including AWS, Azure, or Google Cloud.
• Expertise in DataFrames & Spark SQL, Spark Streaming with Apache Kafka real-time data ingestion pipelines
• Very good conceptual understanding of Multithreading, distributed computing concepts of Pyspark
• Programming: Proficiency in programming languages, including Python, Java, or Scala.
• Communication: Excellent communication and collaboration skills.