Gen AI Architect ( Agentic AI & LLM) (Remote)

Cognizant; Boston (MA); Remote; USD 103,000 - 163,000; Full time

Benefits offered by this job

Health insurance

401(k) plan

Stock purchase plan

Parental leave

Paid time off

Job summary

Cognizant is seeking a Gen AI Architect to lead the design and delivery of enterprise AI applications. You will shape architecture, set standards, and guide engineers across teams to build scalable LLM-driven solutions with agentic AI capabilities.

The role emphasizes governance, observability, and production deployment, with a remote work option available for qualified applicants in the United States.

Qualifications

• 12+ years of experience designing and delivering large-scale distributed systems or complex software.
• Proven success with AI/LLM-powered solutions including agentic AI and RAG platforms.
• Deep expertise in Generative AI tech, OpenAI models, prompts, vector databases, and orchestration.
• Hands-on with LangGraph, LangChain, AutoGen or similar agent frameworks.
• Strong full-stack background with ReactJS and Node.js.
• Ability to define technical strategy, influence architecture, and mentor teams.
• Formal degree in CS/Engineering or equivalent experience.

Responsibilities

• Architect and deliver enterprise-scale Generative AI applications using LLMs and agentic AI.
• Design AI platforms, routing, prompt lifecycle, observability, and governance.
• Lead end-to-end product delivery from architecture to deployment and support.
• Mentor engineers and promote engineering excellence and innovation.
• Establish evaluation frameworks for offline testing and business outcomes.

Skills

Distributed systems

OpenAI models

LangGraph

LangChain

Full-stack

Architecture strategy

Education

CS/Engineering degree

Tools

Temporal

AutoGen

ReactJS

Node.js

LangGraph

LangChain

Job description

Gen AI Architect (Agentic AI & LLM) (Remote)

As a Gen AI Architect ( Agentic AI & LLM) you will play a key role in designing and delivering next-generation AI-powered enterprise applications. You will lead the architecture and development of scalable Generative AI solutions, leveraging Large Language Models (LLMs), Agentic AI frameworks, modern web technologies, and distributed systems.

Working across engineering, product, and business teams, you will define technical strategy, establish architectural standards, mentor engineers, and deliver innovative AI solutions that create measurable business value.

In this role, you will:

• Architect and develop enterprise-scale Generative AI applications utilizing LLMs, RAG, structured data, workflow automation, and intelligent orchestration.
• Design and implement Agentic AI solutions using LangGraph, LangChain, or similar frameworks to support complex reasoning, memory management, tool integration, and human-in-the-loop workflows.
• Build scalable and fault-tolerant workflow orchestration solutions using Temporal or similar technologies.
• Define AI platform architectures covering model routing, prompt lifecycle management, observability, experimentation, governance, and production deployment.
• Establish evaluation frameworks for AI solutions, including offline testing, regression analysis, trace diagnostics, and business outcome measurement.
• Lead end-to-end product delivery, from architecture and development through deployment and operational support.
• Drive engineering best practices focused on scalability, performance, reliability, security, and maintainability.
• Mentor engineering teams and foster a culture of innovation, technical excellence, and continuous learning.

Work model

We strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a remote position open to qualified applicants in the United States. Regardless of your working arrangement, we are here to support a healthy work-life balance through our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you’re engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations

Cognizant cannot provide sponsorship for this role now or in the future.

What you need to have to be considered:

• 12+ years of experience designing and delivering large-scale distributed systems, enterprise platforms, or complex software applications.
• Proven success delivering production-grade AI and LLM-powered solutions, including agentic AI systems, RAG platforms, intelligent automation, or conversational AI applications.
• Deep expertise with Generative AI technologies including OpenAI models, prompt engineering, vector databases, retrieval frameworks, and AI orchestration patterns.
• Hands‑on experience with LangGraph, LangChain, AutoGen, or similar agent development frameworks.
• Strong full‑stack engineering background with expertise in ReactJS, Node.js, and modern application architecture.
• Demonstrated ability to define technical strategy, influence architecture decisions, and mentor engineering teams.
• Strong software engineering fundamentals, including system design, scalability, testing, performance optimization, and code quality practices.
• Bachelor's, Master's, or PhD degree in Computer Science, Engineering, or a related discipline, or equivalent practical experience.

These will help you stand out:

• Experience building AI governance, observability, monitoring, and evaluation frameworks for enterprise environments.
• Expertise with workflow orchestration technologies such as Temporal.
• Experience implementing model experimentation, prompt versioning, and AI production rollout strategies.
• Knowledge of cloud-native architectures and enterprise-scale application modernization initiatives.
• Passion for emerging AI technologies and a demonstrated history of driving innovation across engineering organizations.

Salary and Other Compensation:

Applications will be accepted until October 9th, 2026.

The annual salary for this position is between $ 102.600 to $162,500 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long‑term/Short‑term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law

Applicants may be required to attend interviews in person or by video conference. In addition, candidates may be required to present their current state or government issued ID during each interview.

Cognizant is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to sex, gender identity, sexual orientation, race, color, religion, national origin, disability, protected Veteran status, age, or any other characteristic protected by law.