Senior AI Backend Engineer – Agentic Systems

Neshent Technologies; Village of Floral Park (NY); On-site; USD 225,000 - 250,000; Full time

Benefits offered by this job

Medical Insurance

Dental Insurance

Vision Insurance

401(k)

Unlimited PTO

Job summary

Rafferty Holdings, based in Garden City, NY, seeks a Senior Backend AI Engineer to design and scale distributed AI-backed backend systems. You will lead Agentic AI initiatives, build reusable capabilities, and ensure robust, secure, and scalable deployments.

You will work with LangGraph, LangChain, and multi-agent architectures, shaping the AI center while collaborating with operations and regulatory teams. Hybrid onsite presence in NY area preferred.

Qualifications

• 8+ years of backend engineering experience building scalable distributed systems.
• Strong proficiency in Node.js, TypeScript, and/or Golang.
• Hands-on experience with production-grade LLM applications and Agentic AI systems.
• Experience with multi-agent orchestration, planning, tool integration, memory, and RAG.

Responsibilities

• Design, develop, and maintain scalable backend services, APIs, and microservices.
• Architect and build production-grade Agentic AI and multi-agent systems.
• Develop agent orchestration, planning, tool integration, memory, and RAG capabilities.
• Build shared LLM infrastructure, model gateways, evaluation, and observability frameworks.
• Drive architecture decisions and engineering best practices across AI initiatives.
• Ensure scalability, reliability, security, and cost efficiency.
• Collaborate with DevOps, frontend, product, and ML teams to deliver end-to-end AI solutions.
• Mentor engineers and influence technical direction.

Skills

Node.js

TypeScript

Golang

Distributed systems

Cloud infrastructure

LLMs

Agentic AI

Kubernetes

REST APIs

Microservices

Event-driven

Education

Bachelor's degree in Computer Science, Engineering, or related field

Master's degree preferred

Tools

LangGraph

LangChain

Tool Calling

Memory management

PostgreSQL

MongoDB

Redis

Kafka

Airflow

CI/CD

Job description

Rafferty Holdings, based in Garden City, NY, seeks a Senior Backend AI Engineer to design and scale distributed AI-backed backend systems. You will lead Agentic AI initiatives, build reusable capabilities, and ensure robust, secure, and scalable deployments.

You will work with LangGraph, LangChain, and multi-agent architectures, shaping the AI center while collaborating with operations and regulatory teams. Hybrid onsite presence in NY area preferred.