Senior Big Data Engineer Pyspark Databricks - Vice President

Citibank (Switzerland) AG; Pune District; On-site; Confidential; Full time

Job summary

Citibank (Switzerland) AG in Pune, India seeks a Senior Big Data Engineer with 13+ years in data engineering and Spark expertise. This hybrid VP-level role builds scalable data platforms using PySpark, Delta Lake, and Databricks, collaborating with architects, stakeholders and data scientists to automate and streamline services.

You will work across ECS, Kubernetes, Kafka, and Airflow, ensuring code quality, security, and timely delivery on multiple initiatives while leveraging Hadoop-based

Qualifications

• 13+ years of data engineering experience with strong Spark exposure.
• Proficient in PySpark and Spark development for data processing.
• Experience with Delta Lakehouse, real-time messaging via Kafka, and Hadoop ecosystem.
• Working knowledge of SQL databases and SCM tools like Bitbucket.

Responsibilities

• Evaluate and provide technical solutions for complex, interdependent processes.
• Build and maintain platforms ensuring timely delivery across initiatives.
• Enforce code quality and testing standards within the team.
• Test, debug, and optimize programs; collaborate with architects and stakeholders.
• Coordinate with internal teams to translate requirements into technical solutions.
• Apply knowledge of Databricks, S3, and new data architectures.

Skills

PySpark

Spark architecture

Delta Lake

Kafka

Airflow

Databricks

S3

SQL

Unix

HDFS

Python

Tools

Bitbucket

Unix

Kubernetes

ECS

Job description

## Senior Big Data Engineer Pyspark Databricks - Vice PresidentApplyremote type: Hybridlocations: Pune Maharashtra Indiatime type: Full timeposted on: Posted Todaytime left to apply: End Date: August 28, 2026 (29 days left to apply)job requisition id: 26980501We are looking to hire experienced Data engineer to join our team responsible for building technology solutions for the Markets Business Control Tech and for various business risk and controls functions. You will work with the Architects, Business stakeholders and Data Scientists to ensure we are meeting their requirements to develop and drive automation. This is an exciting opportunity to work on an important project for the group, which will have huge impact on the business and future design in this area.**Key Responsibilities:** Evaluate and provide technical solutions to solve a variety of complex and interdependent processes.* Build and maintain the platform ensuring timely delivery of work items across the multiple initiatives/components.* Ensure all team members adhere to our code quality and testing standards.* Test and debug programs Coordinate with internal teams to understand user requirements and provide technical solutions.* Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analysing/interpreting code* Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems* Apply fundamental knowledge of programming languages for design specifications.* Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging* Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions* Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents* Has the ability to operate with a limited level of direct supervision.**Skills & Experience :*** Experience Professional with 13+ Years of experience in Data engineering with good exposure on **spark architecture*** Good Exposure on **PySpark , Spark development** experience, particularly on data processing and the associated modules* Work **exposure on ECS** , Kubernetes* Have worked on **DeltaLakehouse** and exposure on **consuming real time messages via Kafka*** Basic experience on Unix, hdfs and supported libraries such as PyArrow. Any PySpark experience is preferred as the environment uses Hadoop and Spark and it supports python.* Working knowledge of Databases (SQL) is required.* Working knowledge of BitBucket or equivalent SCM tool is required.* Knowledge of Apache Airflow is desirable Ability to work collaboratively in teams and develop meaningful relationships to achieve common goals* Ability to multi-task and deliver to a tight deadline* Exposure on **New age Data architecture using Databricks and S3**Good to Have :* **Data Bricks Certification*** PL/SQL exposure using traditional Databases* DWH and Datalakehouse concepts------------------------------------------------------## **Job Family Group:**Technology------------------------------------------------------## **Job Family:**Applications Development------------------------------------------------------## **Time Type:**Full time------------------------------------------------------## **Most Relevant Skills**Please see the requirements listed above.------------------------------------------------------## **Other Relevant Skills**For complementary skills, please see above and/or contact the recruiter.------------------------------------------------------*Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.**If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review* *Accessibility at Citi.* *View Citi’s EEO Policy Statement and the Know Your Rights poster.*