Gen AI Architect

Covetus

United States

On-site

USD 180,000 - 240,000

Full time

7 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Covetus seeks an experienced Generative AI Architect to lead the design and delivery of enterprise GenAI solutions. You will partner with stakeholders, data scientists, and engineers to translate business use cases into scalable, secure systems across cloud platforms.

Define blueprints for LLM-based apps, RAG pipelines, and multi-agent workflows. You will oversee solution architecture, data pipelines, governance, and cross-functional leadership to drive production deployments and

Qualifications

  • 10+ years of software engineering, data architecture, or AI/ML engineering experience.
  • 2–3+ years deploying production LLM and GenAI systems.
  • Deep hands-on GenAI stack experience with LLM orchestration frameworks and vector databases.
  • Proficiency in Python and modern microservices architecture, REST/gRPC APIs, Docker/Kubernetes.
  • Experience moving AI prototypes into production with evaluation and monitoring tools.
  • Excellent stakeholder communication and collaboration across teams.

Responsibilities

  • Design end-to-end architecture for enterprise GenAI applications including foundation model selection and multi-agent orchestration.
  • Architect high-performance RAG systems with embedding models and vector databases.
  • Lead the design of agentic workflows with tool use and human-in-the-loop controls.
  • Build scalable AI infrastructure on cloud platforms and implement MLOps best practices.
  • Establish governance, security, and compliance guardrails for production systems.
  • Collaborate with product, business, and engineering to align roadmaps and mentor engineers.

Skills

Python
REST APIs
Distributed systems
Stakeholder management

Education

Master’s degree or Ph.D. in Computer Science / AI / Data Science

Tools

LangChain
LlamaIndex
LangGraph
Semantic Kernel
Pinecone
Weaviate
Milvus
pgvector
Docker
Kubernetes

Job description

We are seeking an experienced Generative AI (GenAI) Architect to lead the design, architecture, and end-to-end delivery of enterprise-grade AI solutions. In this strategic role, you will partner closely with business stakeholders, data scientists, and engineering teams to translate high-impact business use cases into scalable, secure, and production-ready systems. You will define technical blueprints for LLM-based applications, Retrieval-Augmented Generation (RAG) pipelines, and autonomous agentic workflows across modern cloud platforms.

Key Responsibilities
  • Solution Architecture: Design end-to-end architecture for enterprise GenAI applications, including foundation model selection, fine-tuning strategies, prompt engineering frameworks, and multi-agent orchestration.
  • RAG & Data Pipelines: Architect high-performance RAG systems, encompassing document chunking, embedding models, vector databases, hybrid search, and semantic retrieval optimization.
  • Agentic Workflows: Lead the design and implementation of complex, multi-step agentic workflows with tool use, memory management, and human-in-the-loop controls.
  • Cloud & MLOps Integration: Build scalable, resilient, and cost-optimized AI infrastructure on major cloud platforms (AWS, Azure, or GCP), establishing LLMOps best practices for CI/CD, model versioning, and observability.
  • Governance, Security & Compliance: Implement robust enterprise guardrails to ensure data privacy, security, hallucination mitigation, responsible AI compliance, and adherence to regulatory standards.
  • Cross-Functional Leadership: Collaborate directly with product owners, business executives, and software engineering teams to evaluate use case feasibility, establish technical roadmaps, and mentor engineers through production deployment.
Required Qualifications
  • Experience: 10+ years of overall experience in software engineering, data architecture, or AI/ML engineering, with at least 2–3+ years focused on deploying production LLM and Generative AI systems.
  • GenAI Stack Expertise: Deep hands-on experience with LLM orchestration frameworks (e.g., LangChain, LlamaIndex, LangGraph, Semantic Kernel) and vector databases (e.g., Pinecone, Weaviate, Milvus, pgvector).
  • Cloud Proficiency: Strong architectural background in at least one major cloud ecosystem and its native AI services (e.g., AWS Bedrock/SageMaker, Azure OpenAI/AI Studio, or GCP Vertex AI).
  • Programming & APIs: Proficiency in Python and modern microservices architecture, REST/gRPC APIs, containerization (Docker, Kubernetes), and distributed systems.
  • Production Readiness: Proven track record of moving AI prototypes into secure, low-latency, high-availability enterprise production environments, including implementing evaluation frameworks (e.g., RAGAS, TruLens) and monitoring tools.
  • Communication: Exceptional stakeholder management skills with the ability to communicate complex architectural trade-offs to both technical teams and C-level executives.
Preferred Qualifications
  • Experience in regulated industries (e.g., Financial Services, Healthcare, Insurance, or Life Sciences) common to the NY/NJ market.
  • Familiarity with model fine-tuning techniques (LoRA, QLoRA, RLHF) and open-source model hosting (e.g., vLLM, Hugging Face TGI).
  • Master’s degree or Ph.D. in Computer Science, Artificial Intelligence, Data Science, or a related quantitative field.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GenAI Architect
GenAI Architect

Capgemini • New York (NY)

Hybrid
USD 160,000 - 260,000
Generative AI Architect
Generative AI Architect

American IT Systems • Plano (TX)

On-site
USD 150,000 - 230,000
GenAI Solution Architect
GenAI Solution Architect

Centraprise • San Jose (CA)

On-site
USD 180,000 - 250,000
Gen AI Architect
Gen AI Architect

TechDigital Group • Pleasanton (CA)

On-site
USD 180,000 - 280,000
GenAI Architect
GenAI Architect

SIDRAM TECHNOLOGIES • New York (NY)

Hybrid
USD 180,000 - 260,000
Sr. AI Architect
Sr. AI Architect

Ampcus, Inc • Chantilly (VA)

On-site
USD 180,000 - 260,000
Principal Gen AI Scientist — Lead AI Agents & GenAI Apps
Principal Gen AI Scientist — Lead AI Agents & GenAI Apps

Compunnel Inc. • McLean (VA)

On-site
USD 190,000 - 260,000
GenAI Solution Architect - Copilot
GenAI Solution Architect - Copilot

Centraprise • San Jose (CA)

On-site
USD 150,000 - 230,000
Senior AI Engineer - Generative AI & Agentic Systems
Senior AI Engineer - Generative AI & Agentic Systems

Life in Pittsburgh • Pittsburgh

On-site
USD 150,000 - 210,000
GenAI Engineer
GenAI Engineer

Capgemini • New York (NY)

On-site
USD 140,000 - 200,000