AI Architect – Generative AI & Enterprise Solutions

Ex; New York (NY, NJ); Hybrid; USD 150,000 - 170,000; Full time

Job summary

Ex is seeking an AI Architect for Generative AI & Enterprise Solutions in NY/NJ, Hybrid. You will lead end-to-end GenAI architecture, define strategy, and translate complex AI concepts into business value for CXOs.

You will drive production-grade GenAI deployments, select models and toolchains (LangChain, Bedrock), and govern governance, security, and cost optimization across enterprise cloud platforms. Excellent communication required.

Qualifications

• Bachelor's or Master's in CS/Engineering or equivalent practical experience.
• 10+ years in software/AI engineering and architecture with senior leadership.
• Depth in generative AI: LLMs, RAG, agent frameworks.
• Production GenAI experience: design, cost, reliability.
• Hands-on with AWS AI services and cloud infrastructure.

Responsibilities

• Drive the end-to-end architecture and technical vision for generative AI.
• Decide models, frameworks, and agent harnesses balancing capability, latency, cost, and risk.
• Move PoC to production with production-grade designs including orchestration, retrieval (RAG), evaluation, observability, guardrails, and human-in-the-loop.
• Integrate GenAI into existing cloud solutions and CI/CD toolchain for governed capabilities.
• Design for scale and operational excellence for GenAI workloads including token economics and cost optimization.
• Establish the operational foundation with evaluation pipelines, monitoring, drift/quality management, and incident response.

Skills

GenAI expertise

Executive communication

Cloud architecture

RAG & agent frameworks

DevOps tooling

Education

Bachelor's or Master's in CS/Engineering

Tools

LangChain

Amazon Bedrock

Job description

AI Architect – Generative AI & Enterprise Solutions

Trending

Job Info

• Job Identification 17245
• Posting Date 07/22/2026, 04:01 PM
• Job Role Architecture-Cloud Architecture
• Experience (In Years) 9-12

Job Description

Work Location: NY/NJ
Work Mode : Hybrid (2-3 days onsite)
Pay Range :$150K-$170K /Yr Base + Annual Bonus

The posted range is the hiring range for this role — a subset of the broader range available to employees over time — and reflects base salary across our national hiring scale. Final offers are based on several factors, including the candidate's skills and experience, internal pay equity, work location, market conditions for the role, and the specific scope and responsibilities of the position. The top of the range is reserved for candidates who notably exceed the requirements; the lower end applies to those with less experience or fewer preferred qualifications. For positions based in higher-cost zones (e.g., California, New York, New Jersey), actual compensation may exceed the posted range; your recruiter will share specifics during the process

This is a senior, highly visible role that blends deep technical mastery with executive influence. You are expected to be a recognized expert in generative AI – frameworks, agent harnesses, and the realities of production deployment – and equally comfortable in the boardroom, translating complex technology into clear business value for CXO-level stakeholders and helping shape enterprise AI strategy.

Responsibilities

Architecture & Technical Leadership

• Drive the end-to-end architecture and technical visionfor generative AI within the function – reference architectures, patterns, and standards that teams build against.
• Make authoritative technology decisions,selecting the right models, frameworks, and agent harnesses for each use case, balancing capability, latency, cost, and risk.
• Move solutions from proof-of-concept to productionwith realistic, production-grade designs – covering orchestration, retrieval (RAG), evaluation, observability, guardrails, and human-in-the-loop.
• Integrate GenAIinto the existing cloud solutions and automation platform (AWS, CI/CD toolchain, ITSM) so GenAI is a first-class, governed capability.
• Design for scale and operational excellencefor GenAI workloads – throughput, latency, reliability, and cost optimization (token economics, caching, model routing).
• Establish the operational foundationincluding evaluation pipelines, monitoring, drift/quality management, and incident response for Agentic solutions.
• Bake in guardrailssuch as security, data privacy, responsible-AI, hallucination mitigation, and regulatory compliance into every architecture.

Executive Engagement & Strategy

• Advise and influenceto CXO-level leaders, translating complex AI concepts into clear business value, trade-offs, risks, and roadmaps.
• Shape the generative-AI strategy and roadmapfor the enterprise, aligning technology investment with business outcomes and priorities.
• Build and presentbusiness cases, ROI, and build-vs-buy analyses for AI initiatives.
• Serve as an evangelist and trusted expert– to executives, engineering teams, and external partners – and champion an enterprise AI vision.

Enablement & Governance

• Mentor and upskill engineering teams and set architecture governance, review gates, and reusable building blocks.
• Define and stewardAI governance, standards, and best practices in partnership with security, data, and legal.

Qualifications

• Bachelor's or Master's degreein Computer Science, Engineering, or a related field – or equivalent practical experience.
• 10+ years of experiencein software/AI engineering and architecture, including senior technical leadership on large-scale systems.
• Recognized depthin generative AI: LLMs, prompt/context engineering, RAG, agent frameworks (e.g., LangChain, Amazon Bedrock Agents), and agent harnesses.
• Proven track recorddesigning and running GenAI solutions in production at scale – including evaluation, observability, cost, and reliability.
• Deep hands-on knowledgeof AWS and its AI services (e.g., Amazon Bedrock), plus core cloud infrastructure (compute, networking, IAM, containers).
• Strong groundingwith enterprise architecture practices, integration, and the modern DevOps toolchain (GitHub, Jenkins, Artifactory, SonarQube).
• Exceptionalcommunication and executive-presence skills – able to hold credible, persuasive CXO-level conversations and articulate complex technology in business terms.
• Solid understandingof responsible-AI, security, and data-governance considerations for enterprise AI.