Responsibilities
- Design and architect end-to-end platform that integrate with GenAI technologies with a focus on scalability, reliability, and performance.
- This role involves streaming the onboarding and configuration process for integrating applications onto the newly developed Intelligent Document Processing platform.
- Increase the accuracy of the platform for all onboarding workflows.
- Good understanding of RAG based implementation and commercial Large Language Models.
- Implement best DevOps practices, including CI/CD pipelines, automated testing, and containerization (Docker, Kubernetes) to streamline development and deployment processes.
- Allocate work, and act as an advisor/coach developers, analysts, and new team members. Manage Book of Work deliverables and ensure goals are met. Manage risk to the goals with timely mitigation.
- Manage change in priorities and pivot team quickly to deliver on change in priorities.
- Influence and negotiate with senior leaders and communicate with external parties.
- Appropriately assess risk when business decisions are made, demonstrating consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
Qualifications
- 10+ years of industry experience in systems architecture with a Data processing, AI/ML, & DevOps focus.
- Proven experience with improving LLM performance via few shot examples, and prompt chaining in addition to prompt tuning.
- Proven experience with raising and ensuring we meet the bar of expected accuracy with LLMs.
- Work with MRM team to ensure all metrics for LLM usecase are captured accurately and the standards set by MRM.
- Proficiency in AI/ML frameworks (e.g., Langchain) & experience with GenAI tech. Experience in building applications that apply large language models and GenAI to search, chat agents, and guided analytics.
- Strong, working knowledge of DevOps tools (e.g., Jenkins, GitLab, Docker, Kubernetes) and Infrastructure as Code (IaC) practices.
- Understanding of software development practices, microservices architecture, & API design. Experience with data storage solutions (e.g., NoSQL, SQL, data lakes) and pipeline orchestration.
- Excellent analytical and problem‑solving skills with the ability to analyze and troubleshoot technical issues and provide innovative solutions.
- Demonstrated leadership and project management skills.
- Demonstrated experience leading team of developers and ensuring development standards.
- Demonstrated problem solving experience in areas of performance improvement and/or data analysis for inconsistencies.
- Strong communication, collaboration, and mentorship skills— with the ability to articulate technical concepts to non‑technical stakeholders.
Education
- Bachelor’s degree/University degree or equivalent experience
- Master’s degree preferred.
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law. If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi. View Citi’s EEO Policy Statement and the Know Your Rights poster.