Gen AI Architect

Cloud BC Labs; Charlotte (NC); Hybrid; USD 140,000 - 230,000; Full time

Job summary

Cloud BC Labs is seeking a Gen AI Architect in Charlotte, NC, hybrid role to design scalable, secure GenAI solutions for enterprise applications.

The ideal candidate will master Generative AI, LLMs, cloud platforms (AWS/Azure/GCP), RAG, prompt engineering, embeddings, and AI agent frameworks, and will lead architecture reviews, mentorship, and governance for responsible AI. You will collaborate with data engineers to leverage data and optimize performance and cost.

Qualifications

• Strong expertise in Generative AI, LLMs, and AI architecture.
• Experience with cloud platforms (AWS/Azure/GCP) and RAG pipelines.
• Knowledge of embeddings, vector databases, and AI agent frameworks.
• Ability to design secure, scalable GenAI solutions for enterprises.

Responsibilities

• Design end-to-end Generative AI architecture for enterprise apps.
• Architect solutions using LLMs, RAG, AI Agents, prompts, embeddings, and vector DBs.
• Evaluate LLMs based on performance, cost, security, latency, and business needs.
• Design scalable RAG pipelines (ingestion, chunking, retrieval, generation).
• Develop AI Agent architectures with tools, workflows, memory, and orchestration.
• Integrate GenAI with enterprise apps, APIs, databases, and cloud services.
• Design architecture for model serving, monitoring, and lifecycle management.
• Establish governance, privacy, security, and compliance practices.

Skills

Generative AI

LLMs

Cloud platforms

RAG pipelines

Prompt engineering

Vector databases

AI agents

Embeddings

AI architecture

Security governance

Job description

Position : Gen AI Architect

Location : Charlotte, NC (Hybrid)

Term : C2C/W2 Role

Job Summary

We are seeking an experienced
Generative AI Architect to design, architect, and implement scalable, secure, and enterprise-grade GenAI solutions. The ideal candidate will have strong expertise in
Generative AI, LLMs, AWS/Azure/GCP cloud platforms, RAG, AI/ML architecture, prompt engineering, vector databases, and AI agent frameworks.

Key Responsibilities

• Design and define end-to-end Generative AI architecture for enterprise applications.
• Architect solutions using LLMs, RAG, AI Agents, prompt engineering, embeddings, vector databases, and foundation models.
• Evaluate and select appropriate LLMs/foundation models based on performance, cost, security, latency, and business requirements.
• Design scalable RAG pipelines including document ingestion, chunking, embeddings, retrieval, reranking, and response generation.
• Develop and implement AI Agent / Agentic AI architectures using tools, APIs, workflows, memory, and orchestration.
• Integrate GenAI solutions with enterprise applications, APIs, databases, data platforms, and cloud services.
• Design solutions using cloud AI services such as AWS Bedrock, Amazon SageMaker, Azure OpenAI, Azure AI, or Google Vertex AI.
• Define architecture for model serving, inference, monitoring, evaluation, observability, and lifecycle management.
• Establish best practices for Responsible AI, security, privacy, governance, and compliance.
• Design mechanisms to mitigate hallucinations, prompt injection, data leakage, and unauthorized model access.
• Collaborate with data engineering teams to leverage structured and unstructured enterprise data.
• Lead technical discussions, architecture reviews, proof-of-concepts, and technology evaluations.
• Provide technical guidance and mentorship to AI/ML engineers and development teams.
• Optimize GenAI applications for performance, scalability, reliability, latency, and cost.
• Create architecture diagrams, technical design documents, standards, and implementation guidelines.

Cloud BC Labs Inc is a digital transformation organization aimed at creating seamless solutions for clients to effectively manage their business operations. The company specializes in Business and Management Consulting, AI/ML, Data Analytics & Visualization, Cloud Data Warehouse Migration, Snowflake Implementation, Informatica Implementation & Upgrade, Staffing Services and Data Management Solutions