Generative AI VP Engineer: Lead LLM Systems

Citi; New York (NY); On-site; Full time

Job description

Generative AI Senior Engineer (Python/Java) – Vice President

Apply (opens in new window)

Job Req Id:

26955200

Location(s):

Pune, Maharashtra, India

Job Type:

Hybrid

Posted:

May. 11, 2026

Discover your future at Citi

Working at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact.

Job Overview

The Applications Development Technology Lead Analyst is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.

Responsibilities:

• Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
• Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
• Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
• Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
• Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
• Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
• Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
• Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Recommended Qualifications:

• 10 years of relevant experience in Apps Development or systems analysis role
• Deep expertise in Large Language Models (LLMs) including OpenAI, Gemini, Claude, Llama, and local/open‑source models
• Strong hands‑on experience with Python, FastAPI, async programming, SQL and high‑performance AI APIs
• Extensive experience with Gen‑AI frameworks such as LangChain, LangGraph, LlamaIndex, and Hugging Face
• Proven experience designing and implementing:
  • Retrieval‑Augmented Generation (RAG) systems
  • Vector databases (PostgreSQL + pgvector, Pinecone, Weaviate, FAISS, etc.)
  • Advanced retrieval strategies (hybrid search, re‑ranking, metadata filtering)
• Experience with multi‑agent systems, workflow orchestration, and stateful AI applications
• Solid grounding in ML/DL concepts, with hands‑on experience using PyTorch and/or TensorFlow, including fine‑tuning and embeddings
• Strong understanding of prompt engineering, workflow design, and Gen‑AI optimization (latency, cost, accuracy)
• Experience deploying Gen‑AI systems using Docker, production APIs, and monitoring/observability tools
• Understanding of AI system evaluation, safety, and governance (hallucination handling, guardrails, feedback loops)
• Tech leadership responsibilities including architecture ownership, design reviews, and mentoring AI engineers
• Familiarity with at least one major cloud provider (AWS, GCP, or Azure)
• Extensive experience system analysis and in programming of software applications
• Experience in managing and implementing successful projects
• Subject Matter Expert (SME) in at least one area of Applications Development
• Ability to adjust priorities quickly as circumstances dictate
• Demonstrated leadership and project management skills
• Consistently demonstrates clear and concise written and verbal communication

Education:

• Bachelor’s degree/University degree or equivalent experience
• Master’s degree preferred

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi (opens in new window).

View Citi’s EEO Policy Statement (opens in new window) and the Know Your Rights (opens in new window) poster.

Apply (opens in new window)