Gen. AI Engineer

Kaleidoscope Innovation, Inc.; Charlotte (NC); On-site; USD 150,000 - 210,000; Full time

Job summary

Kaleidoscope Innovation, Inc. seeks a Senior GenAI/Agentic AI Engineer to design, build, and deploy enterprise-scale AI applications using LLMs, RAG, and agentic architectures.

You will create scalable ingestion, embedding, and vector search pipelines and develop AI agents with LangChain, LangGraph, CrewAI, LlamaIndex, or AutoGen. You will implement secure backend services and modern front-ends, deploying on AWS, Azure, and GCP with Docker, Kubernetes, and IaC.

Qualifications

• 8+ years in software, cloud, AI/ML, or platform engineering.
• 3+ years building production GenAI or LLM apps.
• Strong Python and API development with FastAPI/Flask.
• Experience with RAG and vector DBs (Pinecone, Weaviate, Chroma, Milvus, Azure AI Search).
• Hands-on with LangChain, LangGraph, CrewAI, LlamaIndex, Semantic Kernel, AutoGen.
• Deep knowledge of prompt engineering, tool calls, agent orchestration.
• Cloud-native apps on AWS, Azure, or GCP; Docker, Kubernetes, Terraform, CI/CD.
• Secure, governance-driven design; integrate with databases and APIs.

Responsibilities

• Design and build enterprise Generative AI apps with LLMs, RAG and multi-agent architectures.
• Create scalable ingestion, embedding, retrieval, and vector search pipelines.
• Develop AI agents using LangChain, LangGraph, CrewAI, LlamaIndex, AutoGen, or similar.
• Create secure backend services and APIs using Python frameworks.
• Build AI-powered web apps with React, Angular, or Next.js.
• Deploy cloud-native AI solutions on AWS/Azure/GCP with Docker/Kubernetes.
• Implement observability, LLMOps, governance for production reliability.
• Collaborate with product, engineering, architecture, and business stakeholders.

Skills

8+ years software engineering

3+ years GenAI prod apps

Python API development

LLM/RAG vector DBs

Agentic AI frameworks

Prompt engineering & tools

Cloud-native (AWS/Azure/GCP)

Docker/Kubernetes/Terraform/CI-CD

Security & responsible AI

Databases/APIs integration

Tools

LangChain

LangGraph

CrewAI

LlamaIndex

Semantic Kernel

AutoGen

FastAPI

Flask

React

Angular

Next.js

Job description

Overview

We are seeking a Senior GenAI / Agentic AI Engineer to design, build, and deploy enterprise-scale AI applications that leverage Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, and cloud-native technologies. This is a hands-on engineering role focused on building production-ready AI platforms from architecture through deployment.

Overview

We are seeking a Senior GenAI / Agentic AI Engineer to design, build, and deploy enterprise-scale AI applications that leverage Large Language Models (LLMs), Retrieval-Augmented Generation (RAG), Agentic AI, and cloud-native technologies. This is a hands-on engineering role focused on building production-ready AI platforms from architecture through deployment. The ideal candidate has extensive experience developing scalable AI solutions, integrating LLMs into enterprise applications, and delivering secure, reliable systems that operate in production environments.

Responsibilities

• Design and develop enterprise Generative AI applications using LLMs, RAG, Graph RAG, and multi-agent architectures.
• Build scalable document ingestion, embedding, retrieval, and vector search pipelines.
• Develop AI agents using frameworks such as LangChain, LangGraph, CrewAI, LlamaIndex, AutoGen, or similar technologies.
• Create secure backend services and APIs using Python, FastAPI, Flask, or comparable frameworks.
• Build intuitive AI-powered web applications using modern front-end technologies such as React, Angular, or Next.js.
• Deploy cloud-native AI solutions across AWS, Azure, and GCP using Docker, Kubernetes, and Infrastructure-as-Code.
• Implement observability, monitoring, LLMOps, and governance to ensure production reliability and responsible AI practices.
• Collaborate with product, engineering, architecture, and business stakeholders to deliver enterprise AI solutions.

Required Qualifications

• 8+ years of software engineering, cloud engineering, AI/ML, or platform engineering experience.
• 3+ years of hands-on experience building production Generative AI or LLM-based applications.
• Strong expertise with Python and API development using FastAPI, Flask, or similar frameworks.
• Experience building Retrieval-Augmented Generation (RAG) solutions and working with vector databases such as Pinecone, Weaviate, Chroma, Milvus, or Azure AI Search.
• Experience with Agentic AI frameworks including LangChain, LangGraph, CrewAI, LlamaIndex, Semantic Kernel, or AutoGen.
• Strong understanding of prompt engineering, tool calling, agent orchestration, and workflow automation.
• Experience developing cloud-native applications on AWS, Azure, or GCP.
• Hands-on experience with Docker, Kubernetes, Terraform, CI/CD pipelines, and modern DevOps practices.
• Experience integrating enterprise AI applications with databases, APIs, and business systems.
• Strong understanding of security, governance, and responsible AI best practices.

Preferred Qualifications

• Experience implementing Graph RAG and knowledge graph solutions.
• Experience with MCP (Model Context Protocol) architecture.
• Experience deploying models using vLLM, Hugging Face, Triton, or TensorRT-LLM.
• Experience with Databricks, Spark, Kafka, Snowflake, or modern data engineering platforms.
• Experience building AI applications within regulated industries such as Financial Services, Healthcare, or Insurance.
• Azure, AWS, Google Cloud, or Databricks AI certifications.

Technical Environment

• Languages: Python, JavaScript/TypeScript, SQL
• Frameworks: LangChain, LangGraph, CrewAI, LlamaIndex, FastAPI, Flask, React, Angular, Next.js
• Cloud: AWS, Azure, GCP
• Vector Databases: Pinecone, Weaviate, Chroma, Milvus, Azure AI Search
• DevOps: Docker, Kubernetes, Terraform, GitHub Actions, Jenkins
• AI Platforms: OpenAI, Claude, Gemini, Llama, AWS Bedrock, Azure OpenAI

Kaleidoscope, an Infosys Company, is an equal opportunity employer, and all qualified applicants will receive consideration without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, spouse of protected veteran, or disability.