Pyspark Developer

ZettaMine Labs; Pune District; On-site; INR 1,000,000 - 1,800,000; Full time

Job summary

Zettamine Labs is looking for a skilled PySpark Developer with over 5 years of experience to design, develop, and optimize big data solutions, specifically in Chennai and Pune. The ideal candidate should be proficient in Apache Spark and Python, with a strong ability to troubleshoot and collaborate effectively with data teams. Responsibilities include maintaining scalable data pipelines and ensuring data quality, with a notice period of 0-20 days. Join Zettamine Labs to engage in innovative data processing solutions.

Qualifications

• 5+ years of experience in designing, developing, and optimizing big data solutions with PySpark.
• Expertise in Apache Spark, Python, and distributed computing.
• Strong problem-solving skills.

Responsibilities

• Develop and maintain scalable data processing pipelines using PySpark.
• Optimize and tune PySpark jobs for performance.
• Collaborate with data engineers and analysts on data requirements.
• Ensure data quality and integrity throughout the data lifecycle.
• Troubleshoot and resolve data processing issues.

Skills

PySpark

Apache Spark

Python

Distributed computing

Data processing

Job description

Overview

We are Hiring PySpark Developer for Pune and Chennai Location

Exp- 6 to 10 Years

We are looking for a highly skilled PySpark Developer with 5+ years of experience in designing, developing, and optimizing big data solutions. The ideal candidate will have expertise in Apache Spark, Python, and distributed computing to process large datasets efficiently.

Responsibilities

• Develop and maintain scalable data processing pipelines using PySpark.
• Optimize and tune PySpark jobs for performance and efficiency.
• Collaborate with data engineers and analysts to understand data requirements.
• Ensure data quality and integrity throughout the data lifecycle.
• Troubleshoot and resolve data processing issues.
• Deploy and manage big data solutions in a distributed computing environment.
• Participate in code reviews and provide constructive feedback.

Qualifications

• 5+ years of experience in designing, developing, and optimizing big data solutions with PySpark.
• Expertise in Apache Spark, Python, and distributed computing to process large datasets efficiently.
• Experience in deploying and managing big data solutions in distributed computing environments.
• Strong problem-solving skills and ability to collaborate with data engineers and analysts.
• Notice period: 0-20 days.