Pyspark Python Developer

Wipro; Maharashtra; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Wipro is seeking a highly skilled Senior PySpark Developer in Maharashtra, India, to design, develop, and optimize data pipelines using PySpark, Python, and SQL. The role involves building scalable batch and streaming solutions, working in distributed environments, and collaborating with stakeholders to deliver robust data engineering solutions.

The ideal candidate will have 3–5 years of hands-on experience, strong scripting skills, and the ability to independently design and support data

Qualifications

• Strong Python programming with data processing and performance optimization.
• Extensive PySpark development experience including design, execution, and tuning.
• Hands-on SQL coding expertise.
• Experience in ELT/ETL pipeline development and data integration frameworks.
• Proficiency in Unix/Linux shell scripting for automation and troubleshooting.
• Experience with batch and streaming data processing in distributed environments.
• Ability to design and optimize large-scale data workflows for performance and scalability.
• Solid understanding of distributed computing concepts and big data architectures.
• Experience gathering requirements, designing solutions, and documenting technical details.
• Strong analytical and communication skills for collaboration with stakeholders.

Job description

are seeking a highly skilled Senior PySpark Developer with strong expertise in Python programming, PySpark, SQL, UNIX scripting, and ELT/ETL data processing. The ideal candidate should have hands‑on experience building scalable data pipelines, processing large datasets, and developing batch and streaming solutions in distributed environments. The candidate should be capable of independently designing, developing, optimizing, and supporting data engineering solutions while effectively collaborating with stakeholders.

Must‑Have Skills

• Strong Python programming skills with expertise in coding, data processing, and performance optimization.
• Extensive hands‑on experience in PySpark development, including application design, job execution, performance tuning, and troubleshooting.
• Hands‑on experience in SQL coding
• Experience in ELT/ETL pipeline development and data integration frameworks.
• Proficiency in UNIX/Linux Shell Scripting, including creating, modifying, and troubleshooting scripts.
• Experience with batch and real‑time/streaming data processing using modern data engineering technologies.
• Ability to handle large‑scale data processing and optimize data workflows for performance and scalability.
• Good understanding of distributed computing concepts and big data architecture.
• Experience in requirement gathering, solution design, technical documentation, and implementation.
• Strong analytical and problem‑solving skills.
• Excellent verbal and written communication skills with the ability to work effectively with technical and business stakeholders

Mandatory Skills: PySpark Open Source .

Experience: 3-5 Years .

Reinvent your world. We are building a modern Wipro. We are an end‑to‑end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention.