PySpark Big Data Developer

Citi; New York (NY); Hybrid; USD 90,000 - 120,000; Full time

Benefits offered by this job

Professional development opportunities

Social benefits including medical care and insurance

Flexible working hours

Job summary

Citi is seeking a PySpark Big Data Developer in New York, NY, to work on end-to-end application development and collaborate with cross-functional teams in an international environment. The ideal candidate will have over 4 years' experience in Python, SQL, and PySpark, as well as familiarity with big data tools and distributed processing.

We offer a range of benefits including professional development opportunities, attractive employment conditions, and flexible working hours. Join us to participate in exciting projects in global investment banking.

Qualifications

• At least 4+ years’ experience in Python, SQL and PySpark.
• Proficiency in distributed data processing and big data tools.
• Experience with integration of data from multiple sources.

Responsibilities

• Work with a cross‑functional and geographically dispersed team for quality assurance.
• Perform end‑to‑end features development including deployment and maintenance.
• Collaborate with multiple teams to execute features.

Skills

Python

SQL

PySpark

Hadoop

HDFS

YARN

Spark

Hive

FASTAPI

FLASK

DevOps

Linux/Unix

Education

Bachelor’s degree in technology/engineering or related field

Tools

OpenShift

TeamCity

uDeploy

BitBucket

GitHub

Job description

PySpark Big Data Developer

Job Req Id: 26948633

Location(s): Pune, Maharashtra, India

Job Type: Hybrid

Posted: Apr. 03, 2026

Description

• Work with a cross‑functional and geographically dispersed team for quality assurance
• Perform end‑to‑end features development of application including requirements understanding, impact analysis, development and execution, production deployment and maintenance
• Work with multiple teams to develop, and execute features
• Work with teams in a collaborative style to engage partners and proactively manage activities

Skills

• At least 4+ years’ experience in Python, SQL and PySpark.
• Proficiency in distributed data processing and big data tools and technologies: Hadoop, HDFS, YARN, Spark, Hive
• API's and backend development (FASTAPI / FLASK)
• Devops: GIT, CI/CD basics, Linux/Unix commands
• Design, develop, and maintain big data pipelines using PySpark
• Experience with integration of data from multiple data sources
• Experience in DevTools like OpenShift, TeamCity, uDeploy, BitBucket, GitHub
• Proactively contribute to stability of overall production systems and troubleshoot key components and processes
• Keep track of latest technology trends and proactively learn new technologies driving practical and reference implementations

Nice to have

• Experience with NoSQL databases, such as Elasticsearch
• Understanding of LLMs, prompt engineering, Data query systems (NL to SQL), basic knowledge of vector databases (FAISS, Pinecone etc)

Qualifications

• Bachelor’s degree (preferably in technology / engineering or related field).

What we offer

• Opportunity for professional development in the international and multicultural organization
• Unique opportunity to participate in global investment banking projects
• Internal and external trainings
• Developing opportunities and challenging assignments
• Attractive and stable employment conditions
• Social benefits (medical care, Benefit System, life insurance, pension scheme)
• Flexible working hours

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review, see Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.