Senior Data Engineer - AI-First Real-Time Data Pipelines

Citibank (Switzerland) AG; Irving (TX); Hybrid; Confidential; Full time

Job summary

Citi is hiring a Senior Data Engineer to own end-to-end data platforms in a hybrid Irving, TX team. You will build scalable Hadoop pipelines, real-time streaming with Kafka, and apply AI/ML lifecycle practices while mentoring others. Strong autonomy and banking-domain insight are required.

Role emphasizes hands-on development with Spark/PySpark, Python, FastAPI, and cloud exposure across AWS/Azure/GC, delivering secure, compliant data solutions with high throughput and low latency.

Qualifications

• 7+ years in developing and optimizing Hadoop-based data platforms with real-time streaming.
• Strong hands-on in AI/ML lifecycle management and GenAI concepts.
• Proficient in Python, PySpark, SQL and cloud platforms (AWS/Azure/GC).
• Experience delivering end-to-end data solutions in banking/fintech domains.

Responsibilities

• Develop and maintain scalable Hadoop-based data pipelines and real-time streaming.
• Implement real-time streaming with Kafka and optimize performance and latency.
• Mentor team members and contribute to MLOps initiatives and AI-first tooling.
• Collaborate in an agile squad to translate data needs into concrete specs.

Skills

Hadoop

Kafka

Python

PySpark

FastAPI

SQL

Unix

Cloud (AWS/Azure/GC)

MLOps

GenAI concepts

AI coding tools (Copilot/Devin)

AI/ML lifecycle

Spark

Education

Bachelor's degree

Master’s degree preferred

Tools

HDFS

YARN

MapReduce

Hive

HBase

Spark

Kafka

FastAPI

AWS

Azure

Google Cloud

Job description

Citi is hiring a Senior Data Engineer to own end-to-end data platforms in a hybrid Irving, TX team. You will build scalable Hadoop pipelines, real-time streaming with Kafka, and apply AI/ML lifecycle practices while mentoring others. Strong autonomy and banking-domain insight are required.

Role emphasizes hands-on development with Spark/PySpark, Python, FastAPI, and cloud exposure across AWS/Azure/GC, delivering secure, compliant data solutions with high throughput and low latency.