Enterprise GenAI Architect: LLM Orchestration & RAG

Covetus

United States

On-site

USD 180,000 - 240,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Covetus seeks an experienced Generative AI Architect to lead the design and delivery of enterprise GenAI solutions. You will partner with stakeholders, data scientists, and engineers to translate business use cases into scalable, secure systems across cloud platforms.

Define blueprints for LLM-based apps, RAG pipelines, and multi-agent workflows. You will oversee solution architecture, data pipelines, governance, and cross-functional leadership to drive production deployments and

Qualifications

  • 10+ years of software engineering, data architecture, or AI/ML engineering experience.
  • 2–3+ years deploying production LLM and GenAI systems.
  • Deep hands-on GenAI stack experience with LLM orchestration frameworks and vector databases.
  • Proficiency in Python and modern microservices architecture, REST/gRPC APIs, Docker/Kubernetes.
  • Experience moving AI prototypes into production with evaluation and monitoring tools.
  • Excellent stakeholder communication and collaboration across teams.

Responsibilities

  • Design end-to-end architecture for enterprise GenAI applications including foundation model selection and multi-agent orchestration.
  • Architect high-performance RAG systems with embedding models and vector databases.
  • Lead the design of agentic workflows with tool use and human-in-the-loop controls.
  • Build scalable AI infrastructure on cloud platforms and implement MLOps best practices.
  • Establish governance, security, and compliance guardrails for production systems.
  • Collaborate with product, business, and engineering to align roadmaps and mentor engineers.

Skills

Python
REST APIs
Distributed systems
Stakeholder management

Education

Master’s degree or Ph.D. in Computer Science / AI / Data Science

Tools

LangChain
LlamaIndex
LangGraph
Semantic Kernel
Pinecone
Weaviate
Milvus
pgvector
Docker
Kubernetes

Job description

Covetus seeks an experienced Generative AI Architect to lead the design and delivery of enterprise GenAI solutions. You will partner with stakeholders, data scientists, and engineers to translate business use cases into scalable, secure systems across cloud platforms.

Define blueprints for LLM-based apps, RAG pipelines, and multi-agent workflows. You will oversee solution architecture, data pipelines, governance, and cross-functional leadership to drive production deployments and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Enterprise GenAI Architect: LLMs, RAG & Agents
Enterprise GenAI Architect: LLMs, RAG & Agents

Capgemini • New York (NY)

Hybrid
USD 160,000 - 260,000
Remote GenAI Architect: LLMs, RAG & MLOps Lead
Remote GenAI Architect: LLMs, RAG & MLOps Lead

RemoteFetch • Dallas (TX)

Remote
USD 160,000 - 200,000
Medical/Dental/Vision/Life Insurance
Paid holidays plus Paid Time Off
401(k) plan and contributions
+3
Remote GenAI Architect on AWS — LLM/RAG/MLOps Expert
Remote GenAI Architect on AWS — LLM/RAG/MLOps Expert

ConfigUSA • Pennsylvania

Hybrid
USD 120,000 - 160,000
Senior GenAI Architect: Enterprise-Scale LLM & MLOps
Senior GenAI Architect: Enterprise-Scale LLM & MLOps

Quantum Technologies. LLC • Plano (TX)

On-site
USD 150,000 - 230,000
GenAI Architect: Enterprise LLMs & Agentic AI (Hybrid)
GenAI Architect: Enterprise LLMs & Agentic AI (Hybrid)

Cognizant Technology Solutions Corporation • Charlotte (NC)

Hybrid
USD 117,000 - 135,000
Medical/Dental/Vision/Life Insurance
Paid holidays
401(k) plan
+3
Gen AI Architect
Gen AI Architect

Covetus • United States

On-site
USD 180,000 - 240,000
Generative AI Lead Architect - Enterprise LLMs & RAG
Generative AI Lead Architect - Enterprise LLMs & RAG

Synechron • New York (NY)

On-site
USD 125,000 - 150,000
Competitive compensation
Global exposure
Paid annual leave
+5
Enterprise AI Architect: GenAI & LLM Strategy Lead
Enterprise AI Architect: GenAI & LLM Strategy Lead

Ethereum Technologies LLC • Plano (TX)

On-site
USD 180,000 - 280,000
GenAI Architect: Enterprise LLM & AI Platform Lead
GenAI Architect: Enterprise LLM & AI Platform Lead

Synechron • Charlotte (NC)

On-site
USD 180,000 - 260,000
Career growth
International opportunities
Comprehensive benefits
+1
Senior AI Architect — Enterprise Generative AI
Senior AI Architect — Enterprise Generative AI

Robotic Process Automation LLC • Plano (TX)

On-site
USD 210,000 - 270,000