Pyspark Developer

Tata Consultancy Services; Pune City; On-site; INR 800,000 - 1,500,000; Full time

Job summary

A leading technology consulting firm is seeking a Pyspark Developer with 5 to 9 years of experience in data modeling and processing. The ideal candidate excels in building optimized data pipelines using PySpark and Hadoop. Responsibilities include designing efficient data models and supporting real-time data workflows. Strong SQL and Python skills are essential.

Qualifications

• Minimum of 5 years of hands-on experience in designing, building, and optimizing data pipelines.
• Strong testing ethos with proven software engineering capabilities.
• Proven experience working with PySpark for large-scale data processing.

Responsibilities

• Design and implement efficient, scalable data models.
• Optimize Big Data pipelines for performance.
• Support both batch and real-time data workflows.

Skills

PySpark

Hadoop

Python

SQL

Job description

Overview

Greetings from TCS! TCS is hiring for Pyspark Developer

Desired Experience Range: 5 to 9 years

Job Location: Chennai, Mumbai, Pune

Required Skills: PySpark, Hadoop

Responsibilities / Expectations

• Minimum of 5 years of hands-on experience in designing, building, and optimizing data pipelines, data models and spark-based applications in Big Data environments.
• Extensive experience and deep expertise in data modeling and data model concepts, particularly with large datasets, ensuring the design and implementation of efficient, scalable, and high-performing data models.
• Strong software engineer, you take pride in what you’re developing with a strong testing ethos.
• String proficiency in Python programming, with a focus on data processing and analysis
• Proven experience working with PySpark for large-scale data processing and analysis
• Extensive experience in designing, building, and optimizing Big Data pipelines and architectures, with a strong focus on supporting both batch and real-time data workflows.
• In-Depth Knowledge of Spark, including experience with Spark performance tuning techniques to optimal processing efficiency
• Strong SQL skills for querying and manipulating large datasets, with experience in optimizing complex queries for performance

Contact

Regards,

Monisha