GenAI Architect

Cognizant; Brooklyn (OH); Hybrid; USD 130,000 - 155,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays + PTO

401(k) plan and contributions

Disability insurance

Paid Parental Leave

Employee Stock Purchase Plan

Job summary

Cognizant in Brooklyn, OH seeks a GenAI Architect to design and deliver enterprise-scale Generative AI solutions. You will collaborate with product leaders, data scientists, engineers, architecture teams and business stakeholders to build scalable, secure, and responsible AI capabilities.

The role emphasizes end-to-end architecture, LLMs, RAG, AI governance, and compliance, with a hybrid work model requiring 3-4 days in Cognizant offices in Brooklyn, OH.

Qualifications

• 8+ years of experience in software architecture, platform engineering, or related tech leadership.
• 2+ years designing and delivering Generative AI solutions in enterprise environments.
• Strong expertise with large language models and prompt engineering.
• Experience with Retrieval-Augmented Generation (RAG) architectures and vector databases.
• Proficiency in Python, Java, or similar languages.
• Experience with Google Cloud Platform, Kubernetes, and cloud-native architectures.
• Knowledge of MLOps practices including deployment, monitoring, and versioning.
• Experience implementing AI security controls and responsible AI principles.

Responsibilities

• Design and own end-to-end architecture for Generative AI powered products and platforms.
• Lead the implementation of scalable AI solutions using LLMs, multimodal models, RAG, and agent-based architectures.
• Establish architecture standards, patterns, and best practices for prompt engineering and AI governance.
• Partner with product and engineering teams to translate business requirements into AI-enabled capabilities.
• Ensure AI solutions align with security, privacy, and responsible AI standards while delivering business value.

Skills

GenAI Architecture

LLMs & Foundation models

Prompt engineering

AI governance

Python/Java

GCP & Kubernetes

MLOps

AI security & privacy

Tools

Vector databases

AI agent frameworks

Kubernetes

CI/CD pipelines

CI/CD pipelines

Job description

About the role:

As a GenAI Architect, you will make an impact by designing and delivering enterprise-scale Generative AI solutions that drive innovation across business and technology platforms. You will be a valued member of the AI and Engineering team and work collaboratively with product leaders, data scientists, engineers, enterprise architects, and key business stakeholders to develop scalable, secure, and responsible AI solutions.

In this role, you will:

• Design and own end-to-end architecture for Generative AI powered products and platforms.


• Lead the implementation of scalable AI solutions utilizing large language models (LLMs), multimodal models, RAG frameworks, and agent-based architectures.


• Establish architecture standards, patterns, and best practices for prompt engineering, model orchestration, inference optimization, and AI governance.


• Partner with product and engineering teams to translate business requirements into AI-enabled capabilities and technical solutions.


• Ensure all AI solutions align with security, compliance, privacy, and responsible AI standards while delivering business value.

Work model:

We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role’s business requirements, this is a hybrid position requiring 3-4 days a week in a client or Cognizant office in Brooklyn, Ohio. Regardless of your working arrangement, we are here to support a healthy work-life balance though our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you're engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

What you need to have to be considered:

• 8+ years of experience in software architecture, platform engineering, machine learning engineering, or a related technical leadership role.


• 2+ years of hands-on experience designing and implementing Generative AI solutions in enterprise environments.


• Strong expertise with large language models, foundation models, embeddings, prompt engineering, and AI agent frameworks.


• Experience designing and deploying Retrieval-Augmented Generation (RAG) architectures, vector databases, and AI orchestration frameworks.


• Strong programming experience with Python, Java, or similar enterprise development languages.


• Experience with Google Cloud Platform (GCP), cloud-native architectures, Kubernetes, containerization, and CI/CD pipelines.


• Knowledge of MLOps practices including model deployment, monitoring, versioning, and performance optimization.


• Experience in implementing AI security controls, governance frameworks, responsible AI principles, and privacy standards.


• Strong understanding of microservices, event-driven architectures, APIs, and distributed systems.

These will help you stand out:

• Experience in integrating GenAI capabilities into customer-facing digital products.


• Knowledge of multi-agent architectures, workflow automation, and intelligent orchestration platforms.


• Experience with knowledge graphs, metadata-driven architectures, and unstructured data processing.


• Background in regulated industries with enterprise AI governance requirements.


• Familiarity with open-source AI ecosystems and model customization techniques.


• Experience with A/B testing, feature experimentation, and AI product lifecycle management.


• Understanding of cost optimization and low-latency inference strategies for production AI systems.

We're excited to meet people who share our mission and can make an impact in a variety of ways. Don't hesitate to apply, even if you only meet the minimum requirements listed. Think about your transferable experiences and unique skills that make you stand out as someone who can bring new and exciting things to this role.

Salary and Other Compensation

Applications will be accepted until September 13, 2026.

The annual salary for this position is between $ 130,000 - $ 155,000 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance




• Paid holidays plus Paid Time Off




• 401(k) plan and contributions




• Long-term/Short-term Disability




• Paid Parental Leave




• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.