Applied AI/ML Sr. Associate - Small Business

J.P. Morgan; New York (NY); On-site; USD 150,000 - 190,000; Full time

Benefits offered by this job

Competitive base salary

Bonus eligibility

Comprehensive benefits

Job summary

Chase Small Business Banking seeks a Senior Associate Applied AI/ML Scientist to develop agentic AI products for Small Business Lending. You will partner with Product and Engineering to translate needs into production-ready systems, owning prompts, tools, memory, and routing for agent behavior, with evaluations showing improvements in task success, safety, and cost.

You will work with LangChain/LangGraph, fine-tune models, implement guardrails, and apply MLOps practices across the lifecycle.

Qualifications

• Bachelor's, Master's, or PhD in CS or data science with 3+ years of industry experience.
• Strong software engineering experience contributing to production systems.
• Proficient in Python, including asynchronous programming and API development.
• Hands-on experience building and deploying generative AI/LLM apps in production.
• Hands-on experience with LangChain, LangGraph or similar tools.
• Experience implementing evaluations and guardrails with tools like deepeval.
• Experience using tracing/observability tools such as Arize Phoenix.
• Familiarity with ML frameworks (PyTorch, scikit-learn).
• Experience integrating vector databases and search/indexing in AI apps.
• Strong problem-solving and communication skills with stakeholders.

Responsibilities

• Design, build, and deploy ML and generative AI solutions for business needs.
• Develop agentic AI systems with LangChain/LangGraph or similar frameworks.
• Evaluate agent performance with gold/adversarial sets and rubrics.
• Fine-tune models for custom objectives and constraints.
• Implement and tune safety guardrails and spend limits; monitor impact.
• Collaborate with data scientists, product teams, and stakeholders.
• Apply MLOps practices including CI/CD, versioning, observability.
• Work with structured/unstructured data; support retrieval-augmented generation.

Skills

Python

Asynchronous programming

API development

Production ML

LangChain/LangGraph

Evaluation guardrails

MLOps CI/CD

RAG / vector databases

Communication

Education

Bachelor's/Master's/PhD in CS or data science

Tools

LangChain

LangGraph

Arize Phoenix

deepeval

PyTorch

scikit-learn

FastAPI/Flask

Vector databases

Job description

Chase Small Business Banking is a world-class brand serving 7 million small business clients with a full suite of financial services, including lending, deposits, cards, and online solutions.

As a Senior Associate Applied AI/ML Scientist, you will develop and operate agentic AI products supporting Small Business Lending. You will partner with Product and Engineering to translate business needs into production-ready systems - you'll build and own the prompts, tool usage, memory, and routing that shape agent behavior, and build evaluations that show whether each change improves task success, safety, and cost. You will help maintain the continuous learning loop from production traces to failure analysis, evaluation cases, and verified fixes.

Job Responsibilities

• Design, build, and deploy machine learning and generative AI solutions to address business needs.
• Build agentic AI systems with LLM orchestration frameworks such as LangChain, LangGraph, or similar tools.
• Evaluate agent performance with golden and adversarial test sets, LLM-judge rubrics, and evaluation libraries.
• Fine-tune SLMs and open-weight models for custom objectives.
• Implement and tune safety guardrails, including input/output checks, prompt-injection defenses, PII handling, and spend limits; monitor effectiveness and false-positive impact.
• Partner with data scientists, product teams, and business stakeholders to turn requirements into scalable AI/ML solutions.
• Apply MLOps practices such as CI/CD, versioning, observability, and model and prompt lifecycle management.
• Work with structured and unstructured data, integrating relational and vector databases to support retrieval-augmented generation (RAG).
• Present findings clearly to technical and non-technical stakeholders, including senior leaders.

Required Qualifications, Capabilities, and Skills

• Bacholer’s, Master's, or PhD degree in computer science or a data science-related discipline, with 3+ years of industry experience
• Strong software engineering experience contributing to production systems.
• Proficient in Python, including asynchronous programming and API development with FastAPI, Flask, or similar frameworks.
• Hands-on experience building and deploying generative AI or LLM applications in production.
• Hands-on experience with LLM orchestration and agentic AI frameworks such as LangChain, LangGraph, or similar tools.
• Experience implementing evaluations and guardrails using tools including deepeval and similar libraries.
• Experience using tracing observability tools such as Arize Phoenix.
• Familiarity with machine learning frameworks such as PyTorch or scikit-learn, including adapting and fine-tuning of models.
• Experience integrating vector databases and search or indexing systems into AI applications.
• Working knowledge of MLOps, including CI/CD, monitoring, and lifecycle management.
• Strong problem-solving and communication skills, with the ability to work with technical and non-technical stakeholders.

Chase is a leading financial services firm, helping nearly half of America’s households and small businesses achieve their financial goals through a broad range of financial products. Our mission is to create engaged, lifelong relationships and put our customers at the heart of everything we do. We also help small businesses, nonprofits and cities grow, delivering solutions to solve all their financial needs.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit FAQs for more information about requesting an accommodation.

Equal Opportunity Employer/Disability/Veterans Our Consumer & Community Banking division serves our Chase customers through a range of financial services, including personal banking, credit cards, mortgages, auto financing, investment advice, small business loans and payment processing. We’re proud to lead the U.S. in credit card sales and deposit growth and have the most‑used digital solutions – all while ranking first in customer satisfaction. Chase Small Business Banking is a world‑class brand serving 7 million small business clients with a full suite of financial services, including lending, deposits, cards, and online solutions.