Gen. AI Engineer

INFOSYS NOVA HOLDINGS LLC; Charlotte (NC); On-site; USD 115,000 - 140,000; Full time

Job summary

Kaleidoscope, an Infosys Company, seeks a Senior GenAI/Agentic AI Engineer to design, build, and deploy enterprise AI platforms leveraging LLMs, RAG, and agentic AI. The role emphasizes production-grade systems and secure architectures for scalable AI solutions.

You will work across AWS/Azure/GCP, Docker/Kubernetes, and modern DevOps to deliver end-to-end AI capabilities for enterprise needs.

Qualifications

• 8+ years in software, cloud, AI/ML, or platform engineering.
• 3+ years building production Generative AI or LLM-based apps.
• Strong Python expertise and API development with FastAPI/Flask.
• Experience with RAG and vector databases (Pinecone/Weaviate/Chroma/Milvus/Azure AI Search).
• Experience with Agentic AI frameworks (LangChain/LangGraph/CrewAI/LlamaIndex/Semantic Kernel/AutoGen).
• Strong understanding of prompt engineering, tool calling, agent orchestration, and workflow automation.
• Experience developing cloud-native apps on AWS/Azure/GCP.
• Hands-on Docker, Kubernetes, Terraform, CI/CD, and modern DevOps.
• Experience integrating AI apps with databases, APIs, and business systems.
• Security, governance, and responsible AI practices.

Responsibilities

• Design and develop enterprise Generative AI applications using LLMs, RAG, Graph RAG, and multi-agent architectures.
• Build scalable document ingestion, embedding, retrieval, and vector search pipelines.
• Develop AI agents using frameworks such as LangChain, LangGraph, CrewAI, LlamaIndex, AutoGen, or similar technologies.
• Create secure backend services and APIs using Python, FastAPI, Flask, or comparable frameworks.
• Build AI-powered web applications using React, Angular, or Next.js.
• Deploy cloud-native AI solutions across AWS, Azure, and GCP using Docker, Kubernetes, and IaC.
• Implement observability, monitoring, LLMOps, and governance for reliability and responsible AI.
• Collaborate with product, engineering, architecture, and business stakeholders.

Skills

Software engineering

Cloud engineering

AI/ML

API development

Prompt engineering

Security and governance

DevOps practices

Distributed systems

Database integration

Production-grade systems

Tools

Python

FastAPI/Flask

Docker

Kubernetes

Terraform

CI/CD

LangChain/LangGraph/CrewAI

LlamaIndex

Azure/AWS/GCP

Vector databases

Job description

If you are unable to complete this application due to a disability, contact this employer to ask for an accommodation or an alternative application process.

Onsite Services Admin Charlotte, Charlotte, NC, US

2 days ago Requisition ID: 1383

Salary Range: $115,000.00 To $140,000.00 Annually

Overview

We are seeking a Senior GenAI / Agentic AI Engineer to design, build, and deploy enterprise-scale AI applications that leverage Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, and cloud-native technologies. This is a hands‑on engineering role focused on building production‑ready AI platforms from architecture through deployment.

The ideal candidate has extensive experience developing scalable AI solutions, integrating LLMs into enterprise applications, and delivering secure, reliable systems that operate in production environments.

Responsibilities

• Design and develop enterprise Generative AI applications using LLMs, RAG, Graph RAG, and multi‑agent architectures.
• Build scalable document ingestion, embedding, retrieval, and vector search pipelines.
• Develop AI agents using frameworks such as LangChain, LangGraph, CrewAI, LlamaIndex, AutoGen, or similar technologies.
• Create secure backend services and APIs using Python, FastAPI, Flask, or comparable frameworks.
• Build intuitive AI‑powered web applications using modern front‑end technologies such as React, Angular, or Next.js.
• Deploy cloud‑native AI solutions across AWS, Azure, and GCP using Docker, Kubernetes, and Infrastructure‑as‑Code.
• Implement observability, monitoring, LLMOps, and governance to ensure production reliability and responsible AI practices.
• Collaborate with product, engineering, architecture, and business stakeholders to deliver enterprise AI solutions.

Required Qualifications

• 8+ years of software engineering, cloud engineering, AI/ML, or platform engineering experience.
• 3+ years of hands‑on experience building production Generative AI or LLM‑based applications.
• Strong expertise with Python and API development using FastAPI, Flask, or similar frameworks.
• Experience building Retrieval‑Augmented Generation (RAG) solutions and working with vector databases such as Pinecone, Weaviate, Chroma, Milvus, or Azure AI Search.
• Experience with Agentic AI frameworks including LangChain, LangGraph, CrewAI, LlamaIndex, Semantic Kernel, or AutoGen.
• Strong understanding of prompt engineering, tool calling, agent orchestration, and workflow automation.
• Experience developing cloud‑native applications on AWS, Azure, or GCP.
• Hands‑on experience with Docker, Kubernetes, Terraform, CI/CD pipelines, and modern DevOps practices.
• Experience integrating enterprise AI applications with databases, APIs, and business systems.
• Strong understanding of security, governance, and responsible AI best practices.

Preferred Qualifications

• Experience implementing Graph RAG and knowledge graph solutions.
• Experience with MCP (Model Context Protocol) architecture.
• Experience deploying models using vLLM, Hugging Face, Triton, or TensorRT‑LLM.
• Experience with Databricks, Spark, Kafka, Snowflake, or modern data engineering platforms.
• Experience building AI applications within regulated industries such as Financial Services, Healthcare, or Insurance.
• Azure, AWS, Google Cloud, or Databricks AI certifications.

Technical Environment

Kaleidoscope, an Infosys Company, is an equal opportunity employer, and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, spouse of protected veteran, or disability.