Senior Enterprise AI Architect & LLM Platform Lead

NTT DATA North America; Jersey City (NJ); On-site; USD 117,096 - 130,872; Full time

Benefits offered by this job

Health insurance

Vision insurance

Dental insurance

HSA/FSA

Life insurance

Disability insurance

Paid time off

401k match

Job summary

NTT DATA North America in Jersey City, NJ, seeks a Distinguished AI Engineer to lead enterprise AI architecture and GenAI initiatives. You will own reusable platform patterns, LLM deployment, and cloud-agnostic governance across banking use cases.

You will drive AI SDLC standards, MLOps capabilities, and secure, scalable inference across multi-cloud and on-prem environments, while partnering with risk, security, and product teams.

Qualifications

• 10+ years in AI/ML systems, distributed systems, enterprise architecture, or platform engineering.
• Deep experience with LLMs, RAG, embeddings, model serving, AI orchestration, evaluation frameworks, and AI infrastructure.
• Proven track record defining architecture and technical standards across multiple engineering teams.
• Strong AWS cloud architecture experience or comparable hyperscaler depth, with cloud-agnostic AI platform patterns.
• Experience shaping Terraform/IaC standards, DevOps pipelines, secure deployment patterns, observability, resiliency, and platform operating models.

Responsibilities

• Define target-state architecture for AIRP, LLM platforms, model hubs, AI gateways, RAG services, agent frameworks, orchestration layers, and model-serving infrastructure.
• Establish enterprise standards for AI SDLC, LLMOps, MLOps, evaluation, release management, operational resilience, and production support.
• Create AWS implementation patterns that align with a cloud-agnostic blueprint and minimize vendor lock-in.
• Define standards for Terraform modules, reusable IaC templates, environment strategy, pipeline promotion, approvals, observability, secrets, rollback, and operational controls.
• Guide architecture for secure, scalable, and cost-efficient inference across cloud, hybrid, private, and containerized environments.
• Define guardrail patterns for hallucination mitigation, bias monitoring, harmful-content controls, prompt injection defense, data leakage prevention, and human oversight.
• Lead design reviews for critical AI systems and provide technical assurance to architecture, risk, security, and governance forums.
• Partner with cybersecurity, risk, compliance, legal, audit, product, business, and citizen-development enablement teams.
• Assess emerging AI technologies and recommend adoption based on business value, maturity, risk, cost, portability, and regulatory fit.

Skills

LLMOps

AI architecture

AWS cloud

Terraform/IaC

Governance

Model serving

RAG

Stakeholder influence

Tools

Terraform

Job description

NTT DATA North America in Jersey City, NJ, seeks a Distinguished AI Engineer to lead enterprise AI architecture and GenAI initiatives. You will own reusable platform patterns, LLM deployment, and cloud-agnostic governance across banking use cases.

You will drive AI SDLC standards, MLOps capabilities, and secure, scalable inference across multi-cloud and on-prem environments, while partnering with risk, security, and product teams.