Senior Pyspark Developer

V2 Solutions; Chennai District; On-site; INR 1,500,000 - 2,800,000; Full time

Job summary

Luxoft India LLP in Chennai is seeking a Senior PySpark Developer to design and implement scalable data pipelines using PySpark. The role requires 5–10 years of experience with strong Python, Hadoop/Spark expertise, and cloud familiarity.

You will work with MySQL/MongoDB and contribute to robust data processing workflows. Collaborative team player with excellent problem-solving and communication skills is essential.

Qualifications

• 5–10 years of experience in PySpark development.
• Strong proficiency in Python programming.
• Experience with Hadoop and Spark big data frameworks.
• Knowledge of MySQL and MongoDB databases.
• Familiarity with AWS or Azure cloud platforms.
• Excellent problem-solving and communication skills.

Responsibilities

• Design, develop, and deploy scalable data processing pipelines using PySpark.
• Collaborate with cross-functional teams to identify and prioritize requirements.
• Develop and maintain data warehouses and lakes using Hadoop technologies.
• Optimize data processing workflows for performance and reliability.
• Troubleshoot and resolve complex technical issues in development environments.
• Participate in code reviews and contribute to code quality improvements.

Skills

Python

Pyspark

Big data

Spark

Tools

Hadoop

MongoDB

MySQL

AWS

Azure

Job description

# Senior Pyspark DeveloperLuxoft India LLPPosted on September 7, 2026---Experience5 - 10 yrsJob LocationChennai, IndiaVacancy1DesignationPyspark DeveloperJob TypeNot specified---## Job DescriptionWe are looking for a skilled Senior Pyspark Developer with 5 to 10 years of experience. The job location is flexible.Role and Responsibilities* Design, develop, and deploy scalable data processing pipelines using Pyspark.* Collaborate with cross-functional teams to identify and prioritize project requirements.* Develop and maintain large-scale data warehouses and data lakes using Hadoop technologies.* Optimize data processing workflows for performance, scalability, and reliability.* Troubleshoot and resolve complex technical issues in the development environment.* Participate in code reviews and contribute to improving overall code quality.**Job Requirements*** Strong proficiency in Python programming language and its ecosystem.* Experience with big data processing frameworks such as Hadoop and Spark.* Knowledge of database management systems such as MySQL or NoSQL databases like MongoDB.* Familiarity with cloud-based platforms such as AWS or Azure.* Excellent problem-solving skills and attention to detail.* Ability to work collaboratively in a team environment and communicate effectively with stakeholders.