Data Platform Engineer Lead - Python/PySpark, SQL & ETL

Citi; Irving (TX); On-site; USD 107,000 - 161,000; Full time

Job summary

Citi in Irving, TX is seeking a Senior Data Platform Engineer AVP to design and enhance robust data processing solutions using Python, PySpark, SQL Server, and SSIS.

You will develop scalable ETL pipelines, optimize queries, support large-scale data platforms, and collaborate with cross-functional teams to drive data quality, performance, and reliability across enterprise environments.

Qualifications

• 4+ years of data engineering or related roles.
• Strong hands-on Python and PySpark for large-scale processing.
• Proficiency with SQL Server and ETL/data pipelines.
• Experience with SSIS and enterprise data environments.

Responsibilities

• Design, develop, test and support scalable ETL/data pipelines.
• Develop and optimize complex SQL queries and database objects.
• Identify and resolve performance issues via execution plans and indexing.
• Build and support large-scale data processing across platforms.
• Apply data warehousing and modeling principles to ensure scalable solutions.
• Analyze failed jobs, data quality issues and production incidents.
• Develop batch workflows using AutoSys; collaborate with DevOps teams.
• Work with Hadoop ecosystem and related technologies; ensure data quality and monitoring.

Skills

Python

PySpark

SQL

SQL Server

ETL

Data pipelines

CI/CD

Git

Docker/Kubernetes

Education

Bachelor’s degree

Tools

Microsoft SSIS

Hadoop/HDFS/Hive

AutoSys

Job description

Citi in Irving, TX is seeking a Senior Data Platform Engineer AVP to design and enhance robust data processing solutions using Python, PySpark, SQL Server, and SSIS.

You will develop scalable ETL pipelines, optimize queries, support large-scale data platforms, and collaborate with cross-functional teams to drive data quality, performance, and reliability across enterprise environments.