AI-First Senior Data Engineer Lead — Real-Time Kafka Expert

Citigroup Inc.; Irving (TX); On-site; USD 126,000 - 189,000; Full time

Job summary

Citi in Irving, Texas seeks a Senior Data Developer / Lead to design, implement, and optimize real-time data pipelines within our Hadoop ecosystem and streaming platforms. This hands-on role emphasizes end-to-end delivery, strong Python/PySpark skills, and Kafka-based streaming in a banking environment.

The successful candidate will integrate AI/ML capabilities, mentor teammates, and ensure performance, security, and governance of data infrastructure in a small, autonomous squad.

Qualifications

• 7+ years in Hadoop-based and real-time data platforms
• Proven AI/ML exposure and coding tools
• Experience with Kafka and real-time streaming
• Strong Python, PySpark, SQL, Unix
• Banking domain knowledge and regulatory awareness
• End-to-end project delivery track record

Responsibilities

• Develop scalable data solutions in Hadoop ecosystem
• Lead real-time streaming using Kafka
• Mentor squad members and share best practices
• Optimize Hadoop clusters for performance and cost
• Ensure data security and governance in banking context
• Collaborate with engineers and scientists to translate requirements

Skills

Hadoop

Kafka

Python

PySpark

AI/ML

Spark

SQL

Unix

Education

Bachelor’s degree

Master’s degree preferred

Tools

HDFS

YARN

Hive

FastAPI

Spark

Git

Job description

Citi in Irving, Texas seeks a Senior Data Developer / Lead to design, implement, and optimize real-time data pipelines within our Hadoop ecosystem and streaming platforms. This hands-on role emphasizes end-to-end delivery, strong Python/PySpark skills, and Kafka-based streaming in a banking environment.

The successful candidate will integrate AI/ML capabilities, mentor teammates, and ensure performance, security, and governance of data infrastructure in a small, autonomous squad.