Python and Pyspark Developer ( Strictly no Data Engineer )

Orcapod Consulting Services; Pune District, Chennai District, Bengaluru; Hybrid; INR 2,000,000 - 2,500,000; Full time

Job summary

Orcapod Consulting Services in Pune/Bangalore/Chennai/Hyderabad seeks a Python + PySpark Developer with 6+ years of experience. You will design and maintain PySpark-based data processing apps, write complex SQL, and collaborate with stakeholders.

This role excludes data engineering responsibilities and emphasizes backend development using Python/PySpark. Location includes Pune, with other cities possible; strong Python, PySpark, SQL, and distributed computing skills are required.

Qualifications

• 6+ years of Python development experience.
• Hands-on PySpark, Spark SQL, and data processing.
• Strong SQL, data transformation, and Linux/Unix skills.
• Experience with Git and Agile/Scrum environments.

Responsibilities

• Design, develop, and maintain Python and PySpark apps.
• Build scalable data processing and transformations with PySpark.
• Write complex SQL for data extraction and analysis.
• Review code and ensure coding standards.
• Collaborate with stakeholders and tech teams.
• Prepare technical documentation and participate in sprints.

Skills

Python

PySpark

SQL

Distributed computing

OOP & Design Patterns

Git

Linux/Unix

Debugging

Communication

Stakeholder management

Education

Bachelor's degree in CS/IT

Tools

Docker

Kubernetes

Airflow

Spark SQL

AWS

Azure

GCP

REST API

CI/CD

Job description

Role & responsibilities

Job Title: Python + PySpark Developer (Not Data Engineer Profile)

Max Notice Period 30days and Exp 6+ Years

Experience: 6+ Years

Location: Pune / Bangalore / Chennai / Hyderabad

Notice Period: Immediate to 30 Days Preferred

Job Summary

We are seeking an experienced Python + PySpark Developer with 6+ years of hands-on development experience in building scalable data processing applications and backend solutions. The ideal candidate should have strong expertise in Python programming, PySpark development, SQL, and distributed data processing. This role is focused on application development using Python and PySpark and is not a Data Engineer position.

Key Responsibilities

• Design, develop, and maintain Python and PySpark-based applications.
• Build scalable data processing and transformation solutions using PySpark.
• Develop reusable, efficient, and optimized Python code.
• Write complex SQL queries for data extraction, transformation, and analysis.
• Collaborate with business stakeholders and technical teams to understand requirements.
• Perform code reviews and ensure adherence to coding standards and best practices.
• Troubleshoot and optimize application performance.Work in Agile/Scrum environments and participate in sprint ceremonies.
• Develop and maintain technical documentation.

Required Skills

• 6+ years of experience in Python Development.
• Strong hands-on experience with PySpark.
• Expertise in Core Python programming concepts.
• Strong SQL and database development experience.
• Experience in data transformation, processing, and optimization using PySpark.
• Good understanding of Spark architecture and distributed computing.
• Experience with Linux/Unix environments.
• Strong debugging and problem-solving skills.
• Knowledge of Object-Oriented Programming (OOP) and Design Patterns.
• Experience working with Git version control.

Good to Have

• Experience with Spark SQL and DataFrames.
• Exposure to AWS, Azure, or GCP cloud platforms.
• Experience with Airflow for workflow orchestration.
• Knowledge of REST API development using Python.
• Familiarity with Docker and Kubernetes.
• Basic understanding of CI/CD pipelines.

Qualifications

• Bachelor's Degree in Computer Science, Information Technology, or a related field.
• Strong communication and stakeholder management skills.

Budget

20-25 LPA (Based on experience and interview performance)

Keywords

Python Developer, PySpark Developer, Python, PySpark, Spark SQL, SQL, Distributed Computing, Data Processing, Backend Development, Linux, Git, OOP, Agile, AWS, Azure, GCP.