AI Engineer – Agentic Systems

TD Bank Group

New York (NY)

On-site

USD 120,000 - 160,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

TD Bank Group in New York, NY seeks an AI Engineer to build and ship agentic application capabilities, including RAG pipelines and evaluation workflows, for the TDS AI Suite. You will develop agents, skills, and tool integrations connecting to enterprise data sources and APIs.

Responsibilities cover implementing RAG pipelines, structured outputs, monitoring quality and cost, writing clean, tested code, contributing to SDKs, and ensuring security practices.

Qualifications

  • Bachelor's degree or higher in a technical field.
  • 3+ years of software engineering experience, including 1+ year building LLM/GenAI applications.
  • Financial-services domain knowledge.

Responsibilities

  • Develop agents, skills, and tool integrations connected to enterprise data sources and APIs.
  • Implement RAG pipelines, prompt templates, structured outputs, and agent workflows.
  • Build evaluation test sets and automated checks.
  • Monitor quality, latency, and cost in production environments.
  • Write clean, well-tested, documented code and participate in code reviews.
  • Contribute to SDK components, reusable libraries, and developer documentation.

Skills

Python
LLM applications
RAG
structured outputs
prompt engineering
LangGraph
LangChain
FastAPI
Embeddings
Azure AI Search
pgvector
FAISS
Git
Containers
CI/CD
MCP
Unit testing

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

FastAPI
LangGraph
LangChain

Job description

TD Bank is looking for an AI Engineer to build and ship agentic application capabilities, including RAG pipelines and evaluation workflows, for the TDS AI Suite.

Responsibilities
  • Develop agents, skills, and tool integrations, including MCP servers, that connect to enterprise data sources and APIs
  • Implement RAG pipelines, prompt templates, structured outputs, and agent workflows using approved frameworks
  • Build evaluation test sets and automated checks
  • Monitor quality, latency, and cost in lower and production environments
  • Write clean, well-tested, documented code and participate in code reviews
  • Contribute to SDK components, reusable libraries, and developer documentation
  • Troubleshoot issues and support production releases following change management processes
  • Analyze business requirements and conduct program/system research to identify solution components for delivery and problem resolution
  • Develop new applications and perform unit/component testing for initiatives aligned to business needs and technology architecture standards
  • Communicate solution development requirements, contribute to project plans, estimations, timelines, and status updates for management and clients
  • Identify issues that may impact other areas, then resolve or elevate as needed
  • Support business inquiries via small enhancements and break/fix implementations (source code changes)
  • Partner with Business Analysts/Systems Analysts and other developers/Solution Designers to ensure configuration and custom components meet application requirements and performance goals
  • Maintain quality code and standards, support testing cycles and post-production deployment, and participate in peer coding reviews
  • Adhere to standard security coding practices to reduce common coding vulnerabilities
  • Participate in identifying and recommending development/testing solutions and tools
  • Complete unit and integration testing to conform to standards and design specifications
  • Follow enterprise technology delivery practices and project management disciplines, including scope assessment and risk and cost analysis
  • Assist in development and maintenance of processes to prevent issues and support timely incident/problem resolution with appropriate quality measures
  • Perform Systems Administration for supported applications/environments: monitor performance, configure, backup, authentication, and tuning
  • Ensure state-of-health monitoring and monthly SLA targets are in place and met
  • Provide technical expertise during incident management: analyze reports/outages, assess impact, and facilitate internal/external communication
  • Continuously enhance expertise and stay current with emerging technologies and analytical tools
  • Prioritize and manage own workload to deliver quality results and meet timelines
  • Support a positive work environment through service to the business, quality, innovation, and teamwork; communicate issues and points of interest
  • Identify opportunities to enhance productivity, effectiveness, and operational efficiency
  • Build relationships across business/technology partners and program/project managers
  • Participate in team and business-unit knowledge transfer
Requirements
  • Python programming and strong software engineering fundamentals
  • Hands-on experience building LLM applications using patterns such as RAG, tool/function calling, structured outputs, and prompt engineering
  • Experience with an agent/LLM framework such as LangGraph, LangChain, or equivalent
  • Experience building asynchronous APIs and services using FastAPI or equivalent
  • Familiarity with embeddings and vector search technologies such as Azure AI Search, pgvector, FAISS, or equivalent
  • Practical experience with Git, containers, unit testing, and CI/CD
Technologies
  • Python
  • RAG
  • Tool or function calling
  • Structured outputs
  • Prompt engineering
  • LangGraph
  • LangChain
  • FastAPI
  • Embeddings
  • Vector-search technologies: Azure AI Search, pgvector, FAISS
  • Git
  • Containers
  • CI/CD
  • MCP
  • Unit testing
Preferred Qualifications
  • Hands-on engineer who builds and ships agents, skills, tools, RAG pipelines, and workflows using established platform patterns under technical direction of senior engineers
  • Strong focus on code quality, testing, and continuous learning
  • Role primarily delivers agentic application features, not shared platform infrastructure or end-user web experiences
  • Develop agents, skills, and tool integrations (including MCP servers) connected to enterprise data sources and APIs
  • Implement RAG pipelines, prompt templates, structured outputs, and agent workflows using approved frameworks
  • Build evaluation test sets and automated checks; monitor quality, latency, and cost in lower and production environments
  • Write clean, well-tested, documented code and participate in code reviews
  • Contribute to SDK components, reusable libraries, and developer documentation
  • Troubleshoot issues and support production releases aligned with change management processes
Nice-to-Have Skills
  • Exposure to emerging agent interoperability or orchestration patterns such as MCP, A2A, or multi-agent systems
  • Experience with LLM evaluation or observability tools such as LangSmith, OpenTelemetry, Ragas, or equivalent
  • Cloud experience on Azure, AWS, or GCP, including basic Kubernetes knowledge
  • Java experience (example provided: Spring Boot) for integrating agents with enterprise services and APIs
Experience & Education
  • Bachelor's degree in Computer Science, Engineering, or related field
  • 3+ years of software engineering experience, including 1+ year building LLM/GenAI applications
  • Financial-services domain knowledge
Additional Details
  • Location: New York, New York, United States of America (onsite)
  • Hours: 40
  • Line of Business: Technology Solutions
  • Pay Detail: $120,000 - $160,000 USD
  • Salary: USD 120,000 - 160,000 per yearly
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer
AI Engineer

VueData Technologies Private Limited • Kirkland (WA)

On-site
USD 80,000 - 110,000
Health insurance
Paid time off
AI Engineer
AI Engineer

Moring, inc. • Alpharetta (GA)

On-site
USD 60,000 - 80,000
AI Engineer
AI Engineer

Ryan • Dallas (TX)

Hybrid
USD 120,000 - 190,000
Hybrid Work Options
Award-Winning Culture
Generous PTO
+7
Agentic AI Software Engineer
Agentic AI Software Engineer

Harnham • Houston (TX)

Hybrid
USD 162,000 - 198,000
Hybrid work model
Relocation package
On-site 4 days a week
AI Engineer
AI Engineer

Altitude Technology Solutions Inc • Dallas (TX)

Hybrid
USD 140,000 - 190,000
Staff Applied Scientist
Staff Applied Scientist

Robots & Pencils • California

On-site
USD 125,000 - 173,000
AI Engineer – Agentic Systems & RAG
AI Engineer – Agentic Systems & RAG

Altimetrik • Austin (TX)

Hybrid
USD 100,000 - 130,000
AI Applications Developer (Remote, OH, US)
AI Applications Developer (Remote, OH, US)

Software Directory • Ohio

Remote
USD 120,000 - 160,000
AI Engineer
AI Engineer

7Seventy • United States

Remote
USD 130,000 - 150,000
Remote work nationwide
Health benefits
Competitive compensation package
+2
Agentic AI Software Engineer
Agentic AI Software Engineer

Vets Hired • King of Prussia (PA)

On-site
USD 140,000 - 210,000