Enterprise AI Foundation & LLM Engineer

NTT DATA North America; Jersey City (NJ); On-site; USD 150,000 - 230,000; Full time

Job summary

NTT DATA Services in Jersey City, New Jersey, seeks an AI Foundation Model Engineer to design, build, deploy, and optimize enterprise-grade AI systems powered by foundation models and RAG pipelines. The role focuses on production LLM applications, model-serving integrations, and end-to-end MLOps lifecycle on the AIRP platform hosted on AWS.

You'll collaborate with cloud engineering, IaC, and CI/CD teams to advance secure, observable AI services while embedding Responsible AI and governance into

Qualifications

• 7+ years in AI/ML engineering, platform engineering, software engineering, or applied machine learning.
• Hands-on with LLMs, transformers, embeddings, RAG, semantic search and GenAI patterns.
• Strong Python engineering skills with PyTorch, TensorFlow, Hugging Face, LangChain, LlamaIndex, Semantic Kernel or equivalent.

Responsibilities

• Design and implement LLM-powered applications such as knowledge assistants, document intelligence solutions, workflow agents, summarization tools, and decision-support systems.
• Build RAG pipelines using embeddings, chunking strategies, vector databases, semantic retrieval, reranking, grounding and citations.
• Collaborate with cloud engineering on Terraform modules, IaC templates, environment promotion, CI/CD pipelines, release controls and rollback procedures.
• Adapt and optimize models with LoRA, PEFT, instruction tuning, distillation, transfer learning, quantization, and domain adaptation.
• Embed security, privacy, Responsible AI and model risk controls into AI design and delivery.

Tools

Terraform/IaC

CI/CD

Kubernetes

Job description

NTT DATA Services in Jersey City, New Jersey, seeks an AI Foundation Model Engineer to design, build, deploy, and optimize enterprise-grade AI systems powered by foundation models and RAG pipelines. The role focuses on production LLM applications, model-serving integrations, and end-to-end MLOps lifecycle on the AIRP platform hosted on AWS.

You'll collaborate with cloud engineering, IaC, and CI/CD teams to advance secure, observable AI services while embedding Responsible AI and governance into