AI Engineer — Build Secure Generative AI & RAG Apps

Persistent Systems, LLC; New York (NY); On-site; USD 133,000 - 166,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Life insurance

Disability insurance

Paid time off

Flexible spending accounts

401(k) plan with company match

Fitness membership reimbursement

Tuition assistance

Mental health benefits

Pet discounts

Job summary

Persistent Systems, LLC in New York City seeks an AI Engineer to design, build, and deploy secure AI applications that help employees find information, automate work, analyze data, and make better decisions.

You’ll work with business and technical teams to turn ideas into reliable AI solutions using modern generative AI, retrieval-augmented generation (RAG), and agent-based technologies across the full software lifecycle.

Qualifications

• 2–5 years of experience in software engineering, ML, data engineering, or AI engineering.
• Bachelor’s degree in CS/engineering/data science/math or related field (or equivalent).
• Strong Python programming skills.
• Experience building generative AI apps using LangChain/LangGraph or similar frameworks.
• Experience with RAG systems, prompt engineering, and AI app development.
• Experience using Azure AI Foundry, AWS Bedrock, Google Vertex AI, or Databricks.

Responsibilities

• Design, build, test, deploy, and maintain AI-powered applications.
• Develop RAG systems, AI agents, and conversational AI solutions.
• Collaborate with business, engineering, IT, security, and data teams to deliver production-ready AI solutions.
• Build secure data ingestion, retrieval, and search pipelines.
• Evaluate AI models, frameworks, SDKs, and cloud services for performance, cost, security, and business needs.
• Develop Python APIs and services using FastAPI, Docker, and Kubernetes.
• Implement AI safety, security, governance, and monitoring practices.
• Create evaluation frameworks to measure AI quality, latency, cost, and reliability.
• Connect AI solutions to enterprise databases and analytics platforms.
• Document solutions, mentor teammates, review code, and promote engineering best practices.

Skills

Strong Python programming

Communication skills

Problem-solving skills

U.S. Security Clearance eligibility

Education

Bachelor’s degree in CS/Engineering/Data Science/Math or related field

Tools

LangChain

LangGraph

LlamaIndex

CrewAI

AutoGen

Azure AI Foundry

AWS Bedrock

Google Vertex AI

Databricks

FastAPI

Docker

Kubernetes

SQL

Power BI

Job description

Persistent Systems, LLC in New York City seeks an AI Engineer to design, build, and deploy secure AI applications that help employees find information, automate work, analyze data, and make better decisions.

You’ll work with business and technical teams to turn ideas into reliable AI solutions using modern generative AI, retrieval-augmented generation (RAG), and agent-based technologies across the full software lifecycle.