Senior Data Platform Engineer (Hybrid) - PySpark, SQL & ETL

Citi; New York (NY); Hybrid; USD 107,000 - 161,000; Full time

Job summary

Citi in Irving, TX is seeking a Senior Data Platform Engineer AVP to design, develop, and support robust, scalable data processing solutions using Python/PySpark, SQL Server, and SSIS.

You will own ETL pipelines, data models, performance tuning, and production support, collaborating with engineering, infrastructure, and business teams while leveraging AI-assisted development and DevOps practices.

Qualifications

• 4+ years of relevant data engineering or related technology roles.
• Hands-on Python and PySpark for large-scale data processing.
• Strong SQL/T-SQL with Microsoft SQL Server experience.
• Experience with ETL/data pipelines and Microsoft SSIS.
• Experience with Hadoop/HDFS/Hive and distributed data platforms.
• Experience with AutoSys scheduling and batch processing.
• Git, CI/CD and modern development practices.
• Familiarity with Docker/Kubernetes and NoSQL databases such as MongoDB.
• Strong analytical, troubleshooting, and communication skills.

Responsibilities

• Design, develop, test, and support scalable ETL/data-processing pipelines using Python/PySpark, Microsoft BI/SSIS, SQL, and related technologies.
• Develop and optimize complex SQL queries, stored procedures, functions, and data transformations.
• Identify and resolve performance issues through execution plans, indexing, and design optimizations.
• Develop and support solutions processing large data volumes across SQL Server and distributed platforms.
• Apply relational, dimensional, and data-warehouse modelling to build scalable data solutions.
• Analyze failed jobs, data-quality issues, and production incidents; perform root-cause analysis.
• Develop and support batch-processing workflows using AutoSys.
• Work with Hadoop ecosystem technologies like HDFS and Hive.
• Implement data-quality checks, monitoring, and reconciliation in pipelines.
• Participate in code reviews, CI/CD, and DevOps practices; use Git and containers where applicable.

Skills

Python/PySpark

SQL Server

ETL/Data Pipelines

Git

Docker/Kubernetes

Hadoop/HDFS/Hive

AutoSys

NoSQL MongoDB

Education

Bachelor’s degree

Tools

Microsoft SSIS

SQL

AutoSys

Hadoop/HDFS/Hive

Git

Docker/Kubernetes

MongoDB

Job description

Citi in Irving, TX is seeking a Senior Data Platform Engineer AVP to design, develop, and support robust, scalable data processing solutions using Python/PySpark, SQL Server, and SSIS.

You will own ETL pipelines, data models, performance tuning, and production support, collaborating with engineering, infrastructure, and business teams while leveraging AI-assisted development and DevOps practices.