AI Engineer: Build Production-Grade LLM Apps & Pipelines

Kaleidoscope

New York (NY)

On-site

USD 100,000 - 115,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Kaleidoscope, an Infosys company, in Charlotte, NC, is seeking an AI Engineer to build secure, production-grade AI services and agentic workflows. You will design RAG pipelines, expose Python services via FastAPI, and apply MCP, LangGraph and LangChain for scalable model integrations.

Collaborate with product, security and data teams to deliver measurable business outcomes, implement CI/CD, monitoring and data quality controls, and ensure responsible AI and robust operations in production

Qualifications

  • Typically 4+ years of software, data or machine-learning engineering experience, including at least 1 year delivering LLM-enabled applications.

Responsibilities

  • Design and implement production-grade AI applications, copilots and agentic workflows aligned to measurable business outcomes.
  • Build maintainable Python services and expose capabilities through secure, versioned FastAPI interfaces.
  • Design retrieval-augmented generation (RAG) pipelines covering ingestion, chunking, metadata, embedding, retrieval, reranking, citation and evaluation.
  • Integrate and invoke LLMs through provider SDKs or model gateways, applying structured outputs, tool/function calling, retries, rate limits and fallbacks.
  • Use LangGraph to implement stateful workflows and LangChain for model/tool/retriever integrations.
  • Hands-on understanding of MCP servers and MCP clients.
  • Expose enterprise capabilities through MCP tools, resources and prompts, with appropriate schemas and controls.
  • Create and operate Apache Airflow DAGs for ingestion, embedding refresh, evaluation and data quality controls.
  • Design MongoDB document models, indexes and access patterns for state and metadata.
  • Implement automated testing, CI/CD, logging, tracing and runbooks.
  • Partner with product owners and security to translate requirements into safe designs.
  • Document architecture decisions, data lineage and support procedures.

Skills

Python
FastAPI
APIs
LangGraph
LangChain
MongoDB
Airflow
RAG pipelines
MCP
Cloud-native

Education

Bachelor’s degree in CS/Engineering/Math or related

Tools

Azure OpenAI
Anthropic
AWS Bedrock
MongoDB Vector Search

Job description

Kaleidoscope, an Infosys company, in Charlotte, NC, is seeking an AI Engineer to build secure, production-grade AI services and agentic workflows. You will design RAG pipelines, expose Python services via FastAPI, and apply MCP, LangGraph and LangChain for scalable model integrations.

Collaborate with product, security and data teams to deliver measurable business outcomes, implement CI/CD, monitoring and data quality controls, and ensure responsible AI and robust operations in production

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Production AI Engineer – LLM Apps & RAG Pipelines
Production AI Engineer – LLM Apps & RAG Pipelines

INFOSYS NOVA HOLDINGS LLC • Charlotte (NC)

On-site
USD 100,000 - 115,000
Senior GenAI Engineer — Production AI Platforms
Senior GenAI Engineer — Production AI Platforms

INFOSYS NOVA HOLDINGS LLC • Charlotte (NC)

On-site
USD 115,000 - 140,000
AI Engineer
AI Engineer

Kaleidoscope • New York (NY)

On-site
USD 100,000 - 115,000
Senior GenAI & Agentic AI Engineer - Enterprise AI
Senior GenAI & Agentic AI Engineer - Enterprise AI

Kaleidoscope • Charlotte (NC)

On-site
USD 115,000 - 140,000
Lead Cloud & AI Platform Engineer (DevSecOps)
Lead Cloud & AI Platform Engineer (DevSecOps)

Kaleidoscope • Charlotte (NC)

On-site
USD 90,000 - 110,000
Senior GenAI & Agentic AI Engineer for Enterprise
Senior GenAI & Agentic AI Engineer for Enterprise

Kaleidoscope Innovation, Inc. • Charlotte (NC)

On-site
USD 150,000 - 210,000
Senior GenAI Engineer for Enterprise AI Platforms
Senior GenAI Engineer for Enterprise AI Platforms

KALEIDOSCOPE Innovation • Fort Worth (TX)

On-site
USD 140,000 - 190,000
AI Software Engineer — Lead LLM Pipelines & Platform Impact
AI Software Engineer — Lead LLM Pipelines & Platform Impact

Gaya • United States

Remote
USD 110,000 - 160,000
Remote AI Platform Engineer Production-Grade LLM Pipelines
Remote AI Platform Engineer Production-Grade LLM Pipelines

Megsoft Consulting, Inc. • United States

Hybrid
USD 120,000 - 180,000
Senior DevSecOps & AI Platform Architect
Senior DevSecOps & AI Platform Architect

INFOSYS NOVA HOLDINGS LLC • Charlotte (NC)

On-site
USD 90,000 - 110,000