Production AI Engineer - Secure LLM Apps and Workflows

INFOSYS NOVA HOLDINGS LLC

New York (NY)

On-site

USD 100,000 - 115,000

Full time

1 hour ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kaleidoscope, an Infosys Company, is seeking an AI Engineer to build secure, production-ready AI services and agentic workflows using Python, FastAPI, Airflow and LLMs. You will design RAG pipelines, integrate LLMs, and expose capabilities with secure APIs.

You will collaborate with product owners and data security teams to ensure robust, compliant, and scalable AI solutions, including MCP servers and clients. Strong software discipline is essential.

Qualifications

  • 4+ years of software, data or ML engineering experience, incl. at least 1 year delivering LLM-enabled apps.

Responsibilities

  • Design and implement production-grade AI applications, copilots and agentic workflows aligned to measurable business outcomes.
  • Build maintainable Python services and expose capabilities through secure, versioned FastAPI interfaces.
  • Design retrieval-augmented generation (RAG) pipelines covering ingestion, chunking, metadata, embedding and retrieval.
  • Integrate and invoke LLMs through provider SDKs or model gateways with retries and fallbacks.
  • Use LangGraph to implement stateful workflows and LangChain for model/tool integrations.
  • Expose enterprise capabilities through MCP tools with appropriate schemas and controls.
  • Create and operate Apache Airflow DAGs for scheduled ingestion, embedding refresh and QC.
  • Document architecture decisions, data lineage and support procedures.

Skills

Python
FastAPI
LLM
RAG
LangGraph
LangChain
APIs

Education

Bachelor’s degree in computer science, engineering, mathematics or a related discipline

Tools

Apache Airflow
Azure OpenAI
Anthropic
AWS Bedrock
OpenSearch/Elasticsearch
MongoDB
Red Hat OpenShift

Job description

Kaleidoscope, an Infosys Company, is seeking an AI Engineer to build secure, production-ready AI services and agentic workflows using Python, FastAPI, Airflow and LLMs. You will design RAG pipelines, integrate LLMs, and expose capabilities with secure APIs.

You will collaborate with product owners and data security teams to ensure robust, compliant, and scalable AI solutions, including MCP servers and clients. Strong software discipline is essential.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Production AI Engineer – LLM Apps & RAG Pipelines
Production AI Engineer – LLM Apps & RAG Pipelines

INFOSYS NOVA HOLDINGS LLC • Charlotte (NC)

On-site
USD 100,000 - 115,000
AI Engineer
AI Engineer

INFOSYS NOVA HOLDINGS LLC • New York (NY)

On-site
USD 100,000 - 115,000
Senior GenAI Engineer — Production AI Platforms
Senior GenAI Engineer — Production AI Platforms

INFOSYS NOVA HOLDINGS LLC • Charlotte (NC)

On-site
USD 115,000 - 140,000
Senior GenAI & Agentic AI Engineer - Enterprise AI
Senior GenAI & Agentic AI Engineer - Enterprise AI

Kaleidoscope • Charlotte (NC)

On-site
USD 115,000 - 140,000
Remote AI Engineer: LLMs, RAG Apps & Cloud Deployments
Remote AI Engineer: LLMs, RAG Apps & Cloud Deployments

Everestek Technosoft Solutions • United States

Remote
USD 120,000 - 180,000
Remote work
Senior Python AI Engineer - LLM & API Orchestration
Senior Python AI Engineer - LLM & API Orchestration

EPAM Systems • United States

Remote
USD 130,000 - 160,000
Medical Insurance
Dental Insurance
Vision Insurance
+6
Senior AI/ML Engineer – LLM & Automation
Senior AI/ML Engineer – LLM & Automation

Columbia Technology Partners, Inc • Maryland

On-site
USD 160,000 - 185,000
Medical plans
Vision & Dental coverage
401k match
+5
AI Engineer (Python) for LLM & RAG Apps
AI Engineer (Python) for LLM & RAG Apps

Kforce Technology Staffing • United States

Remote
USD 120,000 - 180,000
Comprehensive benefits including medis
medical/dental/vision, HSA, 401(k)
Production AI Engineer: LLM Workflows & Guardrails
Production AI Engineer: LLM Workflows & Guardrails

DataDrone Inc. • United States

Remote
USD 140,000 - 230,000
AI Engineer - LLM Workflows, Python & AWS
AI Engineer - LLM Workflows, Python & AWS

SageCor Solutions • Maryland

On-site
USD 140,000 - 190,000