Generative AI Developer

Citi; New York (NY); Hybrid; USD 94,000 - 142,000; Full time

Job summary

Citi is seeking a Generative AI Developer to join the Controls Technology team. You will build and integrate GenAI apps using pre-trained models and hosted APIs, focusing on context engineering, RAG, and agentic workflows.

The role emphasizes reliability, collaboration with architects, and deployment in production environments. Ideal candidates have 3–5 years in software/AI, strong Python skills, and hands-on experience with GenAI tools, LangChain, and AI governance practices.

Qualifications

• Bachelor's or Master's in CS/Data Science/AI or related field.
• 3–5 years of software/AI development experience with GenAI.
• Experience delivering AI GenAI projects in team settings.

Responsibilities

• Build and integrate GenAI apps using pre-trained models and GenAI APIs.
• Design context engineering workflows with retrieved knowledge and prompts.
• Develop and maintain RAG systems and knowledge graphs.
• Develop agentic AI workflows with tool-calling and memory.
• Collaborate with data scientists and engineers for integration.

Skills

Python

GenAI concepts

Prompt engineering

RAG systems

Knowledge graphs

Agentic AI

GenAI APIs

LangChain

Docker

Git

Education

Bachelor's degree

Master's degree

Tools

Google ADK

LangGraph

CrewAI

OpenAI Agents SDK

LangChain

LlamaIndex

Job description

Generative AI Developer

Job Req Id:

26988032

Location(s):

Mississauga, Ontario, Canada

Job Type:

Hybrid

Posted:

Aug. 24, 2026

Discover your future at Citi

Working at Citi is far more than just a job. A career with us means joining a team of approximately 219,000 dedicated people from around the globe. At Citi, you’ll have the opportunity to grow your career, give back to your community and make a real impact.

Job Overview

We are looking for a skilled Generative AI Developer to join our Controls Technology team and contribute to the development and integration of innovative generative AI solutions. In this role, you'll work closely with senior developers, AI architects, and business stakeholders to build retrieval-grounded, context-aware, and increasingly agentic AI applications that deliver impactful, reliable AI-driven features and products. This role focuses on applying pre-trained and hosted foundation models effectively — through context engineering, RAG, knowledge graphs, and agentic workflows — rather than training or fine-tuning models.

Key Responsibilities

• Build and integrate generative AI applications using pre-trained and hosted foundation models (via managed GenAI APIs and open-model endpoints).
• Design and implement context engineering workflows — assembling system instructions, retrieved knowledge, tool definitions, conversation memory, and task metadata into reliable, token-efficient prompts.
• Contribute to prompt engineering (zero-shot, few-shot, chain-of-thought, role-based prompting) and the development of AI-powered workflows.
• Develop and maintain Retrieval-Augmented Generation (RAG) systems, including chunking, embedding, hybrid (semantic + keyword) search, and re-ranking.
• Assist with building knowledge graphs and Graph RAG pipelines to support multi-hop reasoning and grounded, traceable responses.
• Contribute to agentic workflows — building AI agents with tool-calling, structured planning, and memory, using frameworks such as Google Agent Development Kit (ADK), LangGraph, or CrewAI.
• Integrate agents with external tools and data sources via the Model Context Protocol (MCP) and enable agent-to-agent collaboration via the Agent2Agent (A2A) protocol under guidance.
• Assist with the deployment, monitoring, and maintenance of GenAI and agentic applications in production environments.
• Collaborate with data scientists and engineers to ensure seamless integration of AI capabilities.
• Perform data preprocessing, document ingestion, and API development for AI applications.
• Participate in code reviews, testing, and documentation to ensure quality and reliability.
• Stay updated with advancements in GenAI and agentic AI and share relevant learnings with the team.

Required Technical Skills

• Proficiency in Python for GenAI development, data preprocessing, and scripting.
• Solid understanding of core generative AI concepts — foundation models, LLMs, tokenization, embeddings, and context windows.
• Hands-on experience with prompt engineering and context engineering techniques.
• Experience building RAG systems, including chunking strategies, vector databases, and hybrid search techniques.
• Familiarity with knowledge graphs and an interest in Graph RAG for relationship-aware, multi-hop retrieval.
• Exposure to agentic AI development — building tool-using agents and multi-step workflows with a framework such as Google ADK, LangGraph, CrewAI, or the OpenAI Agents SDK.
• Working knowledge of agent tooling and protocols, including tool/function calling and the Model Context Protocol (MCP); awareness of theA2A protocol for inter-agent communication.
• Understanding of agent harness basics — session/state management, memory, guardrails, and execution controls that make agents reliable.
• Practical experience consuming major GenAI APIs (e.g., OpenAI, Gemini, Claude) and orchestration frameworks such as LangChain and LlamaIndex.
• Understanding of application deployment and containerization (Docker).
• Understanding of version control systems(Git).
• Awareness of AI compliance, data privacy, guardrails, and responsible AI principles.

Required Soft Skills

• Strong teamwork and communication abilities.
• Willingness to learn new AI/GenAI and agentic technologies and frameworks.
• Analytical mindset and attention to detail.
• Openness to feedback and continuous improvement.

Qualifications

• Bachelor's degree or Master's degree in Computer Science, Data Science, AI, or a related field.
• 3–5 years of professional experience in software/AI development, with exposure to Generative AI and agentic AI.
• Experience delivering AI/GenAI projects in a collaborative setting.
• Exposure to cloud-based AI/ML environments (AWS, GCP, or Azure) is a plus.

------------------------------------------------------

Job Family Group:

Technology

------------------------------------------------------

Job Family:

Applications Development

------------------------------------------------------

Time Type:

Full time

------------------------------------------------------

Primary Location Full Time Salary Range:

$94,300.00 - $141,500.00

------------------------------------------------------

Most Relevant Skills

Please see the requirements listed above.

------------------------------------------------------

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

------------------------------------------------------

Automated Processing and AI

We use automated processing, including artificial intelligence, for our legitimate business interests (or our reasonable and appropriate business purposes) to identify and align the candidate's skills and abilities with a specific job opening. Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.

Importantly, all our hiring processes and decisions, including determining your suitability for a role, are conducted, checked, and decided by individuals. Our automated processing and AI do not involve relying on automatic or autonomous decision-making. Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.

------------------------------------------------------

This job opening is for an existing job vacancy.

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.