Senior AI Software Architect (LLMs, RAG, Cloud) - Relocation

Insight Global; Town of Niskayuna (NY); On-site; USD 190,000 - 270,000; Full time

Benefits offered by this job

Relocation Assistance

Job summary

Insight Global seeks an AI Architect to shape enterprise-scale AI products using LLMs, RAG, agents, and orchestration. You will lead cross-functional initiatives and mentor engineers to deliver secure, scalable, reliable systems in a NY-based setting.

You will ensure deployments meet security, scalability, reliability, monitoring, and operability standards across frontend and backend stacks, driving excellence and measurable impact.

Qualifications

• Bachelor's degree in CS/CE or related field is required.
• 10+ years of software engineering experience with production AI/LLM applications.
• Experience with backend and modern frontend technologies, RAG and agent frameworks, vector databases, cloud platforms, Kubernetes, and technical leadership.

Responsibilities

• Define AI architecture and technical strategy for enterprise-scale products.
• Lead cross-functional initiatives, mentor engineers, and ensure deployed products meet standards for security, scalability, reliability, monitoring, and operational excellence.

Skills

Python

Java

Node.js

Go

React

Angular

Vue

Large Language Models

Retrieval-Augmented Generation

AI Agents

LangChain

LlamaIndex

Vector Databases

Cloud Platforms

Kubernetes

Software Architecture

Education

Bachelor's degree in Computer Science, Computer Engineering or related field

Tools

LangChain

LlamaIndex

Vector Databases

Kubernetes

Cloud Platforms

Job description

Insight Global seeks an AI Architect to shape enterprise-scale AI products using LLMs, RAG, agents, and orchestration. You will lead cross-functional initiatives and mentor engineers to deliver secure, scalable, reliable systems in a NY-based setting.

You will ensure deployments meet security, scalability, reliability, monitoring, and operability standards across frontend and backend stacks, driving excellence and measurable impact.