Applied AI Analyst New York, NY

Metropolitan Commercial Bank; New York (NY); Hybrid; USD 120,000 - 150,000; Full time

Job summary

Metropolitan Commercial Bank is seeking an Applied AI Analyst to design, test, and monitor AI/GenAI solutions in a regulated banking environment. You will work with AI Scientists, risk, and business teams on tasks such as AI-assisted loan docs, fraud detection models, and knowledge copilots, with strong governance and privacy-by-design principles.

A meaningful portion of the role covers AI intake, vendor reviews, and documentation to ensure controls meet internal and regulatory standards.

Qualifications

• Minimum 2 years in AI/ML or analytics roles within regulated environments.
• Experience with GenAI, prompts, grounding, and evaluation pipelines.
• Strong documentation, governance, and risk awareness for financial services.
• Bachelor’s degree preferred; related internships or projects considered.

Responsibilities

• Support AI Scientists in building and validating applied AI/GenAI solutions for banking use cases.
• Develop prompts, grounding instructions, and RAG pipelines with embeddings and vector search.
• Document workflows, controls, audits, and governance artifacts for compliance.

Skills

Python

SQL

REST APIs

Notebooks

Git

Data pipelines

Education

Bachelor’s degree in Computer Science or related field

Tools

Snowflake

Foundry Agent Service

Microsoft 365 Copilot

Embeddings / Vector search

Job description

Metropolitan Commercial Bank (the “Bank”) is a full-service commercial bank based in New York City. The Bank provides a broad range of business, commercial, and personal banking products and services to individuals, small businesses, private and public middle-market and corporate enterprises and institutions, municipalities, and local government entities.

Metropolitan Commercial Bank was named one of Newsweek’s Best Regional Banks and Credit Unions 2024. The Bank was ranked by Independent Community Bankers of America among the top ten successful loan producers for 2023 by loan category and asset size for commercial banks with more than $1 billion in assets. Kroll affirmed a BBB+ (investment grade) deposit rating on January 25, 2024. For the fourth time, MCB has earned a place in the Piper Sandler Bank Sm-All Stars Class of 2024.

Metropolitan Commercial Bank operates banking centers and private client offices in Manhattan, Boro Park, Brooklyn and Great Neck on Long Island in New York State.

The Bank is a New York State chartered commercial bank, a member of the Federal Reserve System and the Federal Deposit Insurance Corporation, and an equal housing lender. The parent company of Metropolitan Commercial Bank is Metropolitan Bank Holding Corp. (NYSE: MCB).

Position Summary:

Metropolitan Commercial Bank (the “Bank”) is seeking an Applied AI Analyst to support the design, configuration, testing, and monitoring of applied AI, Generative AI, machine learning, and agentic workflow solutions in a highly regulated banking environment. Working under the guidance of AI Scientists and in partnership with engineering, risk, and business teams, this role focuses on internal human-in-the-loop use cases such as AI-assisted loan documentation generation, fraudulent transaction detection models, policy and knowledge copilots, workflow automation, and other productivity solutions. A meaningful portion of the role is dedicated to AI solution intake and delivery support— learning new business domains, engaging business owners, preparing required documentation, and supporting vendor and risk reviews, so that solutions can be built and deployed under strict control gates and documentation standards aligned to internal and external regulations. The role emphasizes strong documentation, human oversight, privacy-by-design, cybersecurity, and disciplined lifecycle controls aligned to internal and external regulations. The role also emphasizes familiarity with Microsoft Foundry / Foundry Agent Service, approved Microsoft Copilot ecosystems, RAG architectures, and enterprise data platforms such as Snowflake.

Standard 4-day in-office requirement, 1 day remote (of your choosing and subject to manager's approval)

Essential Functions & Responsibilities

• Support AI Scientists in building, configuring, and testing applied AI/GenAI solutions for high-value banking use cases such as credit memo generation, policy/regulatory summarization, knowledge assistants, and internal productivity copilots.
• Develop and refine prompts, grounding instructions, structured outputs, evaluation datasets, and Retrieval-Augmented Generation (RAG) pipelines using embeddings, vector search, document chunking, and metadata-driven retrieval.
• Prepare and transform structured and unstructured data; assist with API integrations, notebooks, and repeatable workflows that improve quality, traceability, and analyst productivity.

Agentic workflow design & orchestration:

• Assist in designing and testing agentic workflows using approved enterprise platforms and frameworks, including multi-agent patterns, human-in-the-loop approvals, handoffs, and subagent / agents-as-tools designs.
• Work with emerging interoperability patterns such as Model Context Protocol (MCP), tool / skill / plugin integration, and Agent-to-Agent (A2A) connectivity under supervision and within approved guardrails.
• Document workflow steps, tool schemas, fallback logic, escalation paths, and safe disablement / rollback procedures for agentic and GenAI solutions.

Microsoft Foundry, Copilot, and enterprise platform enablement:

• Support prototyping and evaluation in Microsoft Foundry / Foundry Agent Service and related Microsoft ecosystems (for example, Microsoft 365 Copilot) while partnering with Engineering and Data teams operating on Snowflake and other approved enterprise platforms.
• Assist with prompt and agent configuration, retrieval integration, logging, model / tool versioning, and operational runbooks.

Evaluation, testing, and monitoring:

• Create and execute test cases for accuracy, groundedness, hallucination, task completion, retrieval quality, bias/fairness, and basic adversarial or prompt-injection scenarios; elevate issues promptly.
• Track KPIs/KRIs, output quality, drift indicators, and user feedback; maintain evidence needed for pilot reviews, production monitoring, and periodic reassessment.

AI governance, intake documentation, and cybersecurity/privacy controls:

• Support AI use-case intake and governance processes by preparing required documentation (e.g., AI intake forms, model/system inventories, change-control artifacts, and audit-ready evidence packs) aligned to MCB’s Trustworthy & Responsible AI Principles and internal approval processes.
• Learn domain and process context for new use cases by speaking with business owners and control partners; translate requirements into clear problem statements, data needs, user journeys, control gates, and documentation required to comply with internal and external regulations.
• Support third-party / AI vendor due diligence by collecting and organizing evidence, reviewing vendor documentation, and helping risk-tier AI vendors and solutions in partnership with Third-Party Risk and Cyber/IT; act as an AI subject matter expert in providing an understanding of AI‑specific risks.
• Apply privacy-by-design, data minimization, access‑control, and secure prompt/data handling practices; follow approved tooling and build standards.

Cross-functional partnership and continuous learning:

• Communicate findings, limitations, and recommendations clearly to AI Scientists, managers, control partners (Model Risk, Compliance/Legal, Cyber/IT, Data Privacy), and business stakeholders; incorporate feedback quickly and accurately.
• Contribute to playbooks, standard operating procedures, and reusable templates for prompts, evaluations, agent patterns, and workflow controls.

Innovation and best practices:

• Stay current on practical applied‑AI methods—including RAG, evaluation frameworks, agentic workflow design, MCP, A2A, and Microsoft Foundry capabilities—and recommend fit‑for‑purpose uses under established control gates.
• Demonstrate sound judgment, curiosity, and willingness to learn from senior AI Scientists while promoting responsible AI, reproducibility, and disciplined execution.

Qualifications & Skills:

• 2+ years of work experience.
• Bachelor’s degree in Computer Science, Data Science, Statistics, Engineering, Information Systems, Mathematics, or a related field is preferred. Relevant internships, apprenticeships, or comparable hands‑on AI, analytics, or automation project experience will be considered.
• Working knowledge of Python, SQL, notebooks, REST APIs, JSON/YAML, and version control (e.g., Git) for data analysis and AI workflow support.
• Understanding of traditional machine learning model development and lifecycle concepts, including model training, data leakage prevention, testing/validation, monitoring, and common performance metrics for classification and regression.
• Familiarity with LLM application patterns, including prompt engineering, structured outputs, function/tool calling, Retrieval-Augmented Generation (RAG), embeddings, and vector search.
• Familiarity with Microsoft Foundry (including Foundry Agent Service), Microsoft 365 Copilot / Copilot Studio concepts, and approved enterprise data/AI platforms such as Snowflake.
• Understanding of agentic workflow concepts such as MCP servers/tools, skills/plugins, subagents or agents-as-tools, handoffs, human-in-the-loop controls, and A2A integration patterns.
• Ability to test and evaluate AI outputs for accuracy, groundedness, hallucination, retrieval quality, bias/fairness, and basic security misuse scenarios.
• Working knowledge of model and data governance concepts, including documentation, monitoring, change control, inventories, audit trails, and three‑lines‑of‑defense oversight in a regulated environment.
• Strong written and verbal communication skills; ability to turn technical findings into clear summaries, test evidence, and action items for business and risk stakeholders.
• Analytical, organized, and adaptable mindset; ability to learn quickly, manage multiple workstreams, and balance innovation with risk discipline.

Preferred Qualifications & Skills

• Financial services exposure in fraud, AML/KYC/CDD/EDD, underwriting, commercial banking, treasury, policy governance, or contact center analytics.
• Hands‑on experience with Microsoft Foundry / Foundry Agent Service, Azure AI Search or equivalent retrieval tooling, M365 Copilot / Copilot Studio, Snowflake, or similar enterprise AI platforms is a plus.
• Experience with RAG architectures, vector databases / vector search, document chunking, metadata extraction, OCR/document understanding, and prompt engineering.
• Exposure to agentic workflow patterns such as MCP tool integration, skills/plugins, handoffs, subagents, A2A, and evaluation frameworks for task completion and tool‑call quality.
• Familiarity with LangChain, Semantic Kernel, LangGraph, Microsoft Agent Framework, or similar orchestration libraries/frameworks is a plus.
• Awareness of external regulations including SR 11‑7, SR 23‑4, AI use‑case intake / inventory processes, privacy, cybersecurity, and third‑party risk expectations in a regulated environment.
• Ability to work in a constantly evolving environment.
• Must have excellent written and verbal communication skills.
• Demonstrate analytical, troubleshooting, and problem‑solving skills.
• The ability to learn new technologies quickly.
• Self‑directed individual with strong organizational and communication skills.
• Ability to synthesize multiple sources of information with an understanding of the bigger picture needs and operations of the Bank.
• Collaborative team player who can find practical solutions in a dynamic work environment.
• Ability to handle ambiguity, manage multiple tasks at once, and shift effectively between priorities.

Potential Salary: $120,000 - $150,000 annually

This salary range reflects base wages and does not include benefits, bonus, or incentive pay. Salary bands are purposefully wide ranging to encompass the different factors considered in determining where a candidate falls in the range, including but not limited to, seniority, performance, experience, education, and any other legitimate, non‑discriminatory factor permitted by law. Final offer amounts are determined by multiple factors including candidate experience and expertise and may vary from the amounts listed here.

Metropolitan Commercial Bank provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

This applies to all terms and conditions of employment, including recruiting, hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training.

MCB maintains a drug free workplace.

Voluntary Self-Identification

For government reporting purposes, we ask candidates to respond to the below self-identification survey.Completion of the form is entirely voluntary. Whatever your decision, it will not be considered in the hiringprocess or thereafter. Any information that you do provide will be recorded and maintained in aconfidential file.

As set forth in Metropolitan Commercial Bank’s Equal Employment Opportunity policy,we do not discriminate on the basis of any protected group status under any applicable law.

If you believe you belong to any of the categories of protected veterans listed below, please indicate by making the appropriate selection.As a government contractor subject to the Vietnam Era Veterans Readjustment Assistance Act (VEVRAA), we request this information in order to measurethe effectiveness of the outreach and positive recruitment efforts we undertake pursuant to VEVRAA. Classification of protected categoriesis as follows:

A "disabled veteran" is one of the following: a veteran of the U.S. military, ground, naval or air service who is entitled to compensation (or who but for the receipt of military retired pay would be entitled to compensation) under laws administered by the Secretary of Veterans Affairs; or a person who was discharged or released from active duty because of a service-connected disability.

A "recently separated veteran" means any veteran during the three-year period beginning on the date of such veteran's discharge or release from active duty in the U.S. military, ground, naval, or air service.

An "active duty wartime or campaign badge veteran" means a veteran who served on active duty in the U.S. military, ground, naval or air service during a war, or in a campaign or expedition for which a campaign badge has been authorized under the laws administered by the Department of Defense.

An "Armed forces service medal veteran" means a veteran who, while serving on active duty in the U.S. military, ground, naval or air service, participated in a United States military operation for which an Armed Forces service medal was awarded pursuant to Executive Order 12985.