Senior PySpark Engineer — Hybrid Pune

Citi; New York (NY); Hybrid; USD 13,000 - 25,000; Full time

Job summary

Citi is seeking a Senior PySpark Developer to join our Applications Development team. This role focuses on implementing and optimizing Spark/PySpark based data processing pipelines within a hybrid work model in Pune, India.

The ideal candidate will have extensive experience with HDFS, YARN, MapReduce, and Spark ecosystem components, and will contribute to design, development, and performance tuning of large-scale data applications.

Qualifications

• Experience in systems analysis and programming of software applications
• Experience in managing and implementing successful projects
• Working knowledge of consulting/project management techniques/methods
• Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
• Strong collaboration and communication skills

Responsibilities

• Conduct feasibility studies, time and cost estimates, IT planning and risk assessment for applications development
• Monitor all phases of development from analysis to implementation and provide support to business users
• Analyze complex problems, evaluate business processes and industry standards, and make evaluative judgments
• Suggest and implement security measures in post-implementation reviews
• Collaborate with users and technology teams to propose advanced programming solutions

Job description

Citi is seeking a Senior PySpark Developer to join our Applications Development team. This role focuses on implementing and optimizing Spark/PySpark based data processing pipelines within a hybrid work model in Pune, India.

The ideal candidate will have extensive experience with HDFS, YARN, MapReduce, and Spark ecosystem components, and will contribute to design, development, and performance tuning of large-scale data applications.