Senior AI Foundational Model Engineer - Remote/Hybrid

NTT DATA Services; Jersey (VA); On-site; USD 140,000 - 210,000; Full time

Job summary

NTT DATA is seeking an AI Foundation Model Engineer in Jersey City, NJ to design, build and deploy enterprise AI systems powered by foundation models and LLMs. You will own end-to-end LLMOps, meet security and governance requirements, and collaborate with Terraform/IaC and CI/CD teams to promote production readiness on the AIRP platform.

Candidate should have 7+ years in AI/ML or related fields, strong Python with PyTorch/TensorFlow, and hands-on AWS AI cloud experience, including model-serving

Qualifications

• 7+ years in AI/ML, platform or software engineering or applied ML.
• Hands-on with LLMs, transformers, embeddings, RAG, semantic search, GenAI patterns.
• Strong Python engineering with PyTorch, TensorFlow, Hugging Face, LangChain, or equivalent.
• Experience deploying production AI services via APIs, containers, Kubernetes, CI/CD and cloud-native services.
• Exposure to AWS AI/cloud services and AIRP patterns; Terraform/IaC and DevOps pipelines.
• Model evaluation, inference optimization, secure data handling and governance.

Responsibilities

• Design and implement LLM-powered applications such as knowledge assistants, document intelligence solutions, workflow agents, summarization tools, and decision-support systems.
• Build RAG pipelines using embeddings, chunking, vector databases, semantic retrieval, reranking and citations.
• Integrate AI capabilities with AWS-hosted platform components including model APIs, gateways, data services, containers and authentication.
• Collaborate on Terraform modules, IaC templates, environment promotion, CI/CD pipelines, release controls and rollback procedures.
• Adapt and optimize models with LoRA, PEFT, instruction tuning, distillation, transfer learning and domain adaptation.
• Optimize inference workloads for latency, throughput, token efficiency, cost, reliability and UX.
• Implement model/app observability, prompt logs, retrieval quality, drift signals, feedback loops and cost telemetry.
• Embed security, Responsible AI and model risk controls into AI design and delivery.
• Create production docs, runbooks, release notes, test evidence and audit-ready records.

Skills

LLMs

Transformers

Embeddings

RAG

Semantic search

Python

PyTorch

TensorFlow

HuggingFace

LangChain

Kubernetes

CI/CD

AWS

Terraform

Tools

Terraform

Kubernetes

CI/CD

AWS services

Job description

NTT DATA is seeking an AI Foundation Model Engineer in Jersey City, NJ to design, build and deploy enterprise AI systems powered by foundation models and LLMs. You will own end-to-end LLMOps, meet security and governance requirements, and collaborate with Terraform/IaC and CI/CD teams to promote production readiness on the AIRP platform.

Candidate should have 7+ years in AI/ML or related fields, strong Python with PyTorch/TensorFlow, and hands-on AWS AI cloud experience, including model-serving