Senior Big Data PySpark Lead Engineer (Hybrid)

Citibank (Switzerland) AG; Jersey City (NJ); Hybrid; Confidential; Full time

Job summary

Citi is seeking a Big Data PySpark Lead Engineer (Vice President) for the Jersey City, NJ area. You will lead design and implementation of scalable data pipelines using PySpark in a large-scale data environment, partnering with Technology teams to deliver robust analytics capabilities.

The role requires deep knowledge of Hadoop tools (Hive, HDFS, Sqoop, Spark, Impala, Scala), advanced SQL, data modeling, and the ability to mentor mid-level developers while ensuring security and governance.

Qualifications

• Bachelor's degree in computer science or related field.
• Significant experience with PySpark and Big Data tools.
• Knowledge of Hadoop ecosystem and distributed data processing.
• Strong SQL and data modeling skills.

Responsibilities

• Build and maintain scalable PySpark data pipelines in a Big Data environment.
• Design data models and data architecture aligned with data warehouse principles.
• Develop real-time and batch data workflows with low latency.
• Write complex queries to analyze data across distributed systems.
• Provide guidance and mentorship to junior developers.

Skills

PySpark

Big Data processing

Hive

HDFS

Sqoop

Spark

Impala

Scala

SQL

Autosys

Shell scripting

Education

Bachelor's degree in a related field

Master's degree preferred

Tools

Autosys

Hive

Sqoop

Spark

Job description

Citi is seeking a Big Data PySpark Lead Engineer (Vice President) for the Jersey City, NJ area. You will lead design and implementation of scalable data pipelines using PySpark in a large-scale data environment, partnering with Technology teams to deliver robust analytics capabilities.

The role requires deep knowledge of Hadoop tools (Hive, HDFS, Sqoop, Spark, Impala, Scala), advanced SQL, data modeling, and the ability to mentor mid-level developers while ensuring security and governance.