Python Engineering AI Lead - Assistant Vice President

Citi; Chennai; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

Citi is hiring a Principal Engineer for the Retail and Wealth Risk Engineering team under Enterprise Risk Technology in Chennai. You will design and maintain scalable data pipelines, deploy AI agents, and drive data mesh/federation initiatives across ELT/ETL processes and microservice integrations.

The role emphasizes Python/PySpark, SQL, data modeling, and cloud-native architectures with CI/CD in a data-intensive environment. Strong communication is essential.

Qualifications

• 8+ years of large-scale application development experience.
• 5+ years in Python and PySpark engineering leading ELT/ETL in Databricks.
• Hands-on agentic AI development with YAML/JSON, FAST API or Spring Boot, Google ADK, LLM integrations; MCP.
• Experience developing and automating microservice integrations for data-intensive apps.
• Proficiency in Python or Scala; strong SQL.
• Deep knowledge of data modeling, warehousing, Data Mesh, and data federation.
• Excellent communication and collaboration abilities.

Responsibilities

• Design, develop, and maintain scalable AI-enabled data pipelines and ELT/ETL processes.
• Build and deploy GEN AI agents using Google ADK and LLMs to support automation and insights.
• Develop data federation layers for lambda/Data Mesh architectures with Starburst.
• Implement microservice integrations with CI/CD across cloud-native infra (OpenShift/Kubernetes).
• Incorporate agentic AI tools and platforms via advanced prompt engineering to boost development efficiency.
• Ensure data quality, security, and governance across data lifecycles.
• Drive continuous improvement in data engineering standards and practices.
• Assess risk and ensure compliance with laws, regulations, and Citi policies.

Skills

Python

PySpark

SQL

Data Modeling

Data Warehousing

Data Mesh

Microservices

YAML

JSON

FAST API

Spring Boot

Google ADK

LLM Integration

Devin.AI

Github Copilot

MCP

Cloud Platforms

Docker

Kubernetes

Frontend (Angular/React)

Education

Bachelor’s degree in Computer Science/Engineering

Master’s degree

Tools

Databricks

Starburst

Job description

We are seeking a highly motivated and experienced Principal Engineer to join our Retail and Wealth Risk Engineering team under the Enterprise Risk Technology platform. This is an intermediate-level position responsible for designing, building, and maintaining robust, scalable data pipelines and solutions that leverage cutting-edge Mandatory platform for the secure and scalable deployment of AI agents, Big Data, Databrick and AI technologies. The ideal candidate is a high-impact individual with a passion for data, analytics, and problem-solving. You will play a key role in driving business engagement and growth by building the next generation of data and analytics platforms.

Responsibilities

• Design, develop, and maintain scalable, enterprise-grade AI agents , supporting ELT/ETL processes to handle large data volumes using the Python, FAST API, Microservices , PySpark, Kafka and Databricks ecosystem.
• Build and Deploy GEN AI Agents using Googles ADK and Google Flash 2.5+ LLMs to support application automation supports and its deep insights, workflow support with HIL - Human in loop architecture.
• Build and maintain data federation layers for lambda and Data Mesh architectures using tools like Starburst, with a strategy for adopting AI-based use cases (e.g., machine learning, deep learning, NLP) to drive efficiency.
• Develop, deploy, and automate microservice integrations to support data-intensive applications, ensuring scalability, resilience, and maintainability using cloud native infrastructure and openshift or Kubernates architecture including CI/CD pipelines.
• Integrate and leverage agentic AI tools (e.g., Devin.AI, Github Copilot) and platforms (e.g., MCP) through advanced prompt engineering to enhance development and operational efficiency.
• Ensure data quality, integrity, and security throughout the entire data lifecycle.
• Contribute to the continuous improvement of data engineering processes, standards, and best practices within the team.
• Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citi, its clients, and assets by driving compliance with applicable laws, rules, and regulations. Adhere to Policy, apply sound ethical judgment, and elevate, manage, and report control issues with transparency.

Qualifications

Required

• 8+ years of overall experience in large-scale application development with recent mandatory platform for the secure and scalable deployment of AI agents into application contexts
• Minimum of 5+ years of proven experience in a Python and pyspark Engineering lead role focused on building enterprise-grade, high-volume ELT/ETL processes using the PySpark and Databricks ecosystem.
• Hands-on experience with agentic AI development using YAML, JSON, FAST API or Spring boot, Google ADK, LLM itegrations, including Devin.AI or Github Copilot, and integrating models via platforms like MCP using advanced prompt engineering.
• Proven experience developing and automating microservice integrations to support data-intensive applications.
• Proficiency in at least one programming language commonly used for data analytics, engineering, such as Python or Scala.
• Strong SQL skills and experience with various relational databases.
• Deep understanding of data modeling, data warehousing concepts, Data Mesh architecture, and data federation.
• Excellent communication, collaboration, and problem-solving skills.

Preferred

• Experience with cloud-based Big Data platforms (e.g., Cloudera, Databricks, AWS, Azure, GCP).
• Experience with frontend technologies such as Angular or React JS for building data-driven application interfaces.
• Practical experience applying AI/ML techniques to solve real-world business problems.
• Familiarity with containerization technologies (e.g., Docker, Kubernetes).
• Experience in data engineering within the banking retail products domain (e.g., Cards, Mortgage, Deposits, Wealth Management).
• Relevant industry certifications (e.g., AWS Certified Big Data - Specialty, Azure Data Engineer Associate).

Education

• Bachelor’s degree in Computer Science, Engineering, or a related field.
• Master’s degree is a plus.

Job Family Group

Technology

Job Family

Applications Development

Time Type

Full time

Most Relevant Skills

Please see the requirements listed above.

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi.

View Citi’s EEO Policy Statement and the Know Your Rights poster.