AWS Data & AI Platform Engineer - AI Guardrails

NTT DATA North America; Charlotte (NC); On-site; USD 70,000 - 75,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401k program

Employee assistance program

AD&D insurance

Flexible spending or health savings

Job summary

NTT DATA is seeking an AWS Data & AI Platform Engineer to join our Charlotte, NC team. The role focuses on designing, developing, and deploying scalable AI solutions across cloud and hybrid environments, with direct model access to OpenAI, Anthropic, and other providers.

You will build APIs, SDKs, guardrails, and orchestration frameworks, while optimizing performance, latency, and cost, in collaboration with security and platform teams.

Qualifications

• 5+ years of hands-on experience with LLM-based applications and GenAI in cloud-native environments.
• 5+ years with large language models (LLMs).
• 5+ years of prompt engineering experience.
• 5+ years of retrieval-augmented generation (RAG).
• 5+ years of experience with agentic workflows.
• 5+ years of model evaluation and governance.
• Proven ability to drive technical innovation and enterprise AI adoption.

Responsibilities

• Design, develop, and deploy scalable AI solutions for enterprise platforms.
• Integrate with frontier AI model providers (e.g., OpenAI, Anthropic) and build APIs/SDKs with guardrails and observability.
• Collaborate with architecture, security, risk, and platform teams to enforce governance and data protection.

Skills

LLM-based applications

GenAI architecture

Prompt engineering

Retrieval-augmented generation

Agentic workflows

Model evaluation

Technical innovation

Education

Bachelor's degree in Computer Science or equivalent work experience

Job description

Company Overview

Req ID: 395878. NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization,

NTT DATA’s Client is currently seeking an AWS Data & AI Platform Engineer to join our team in Charlotte, North Carolina (US-NC), United States (US).

Travel: This position requires someone to be in a client office 5 days a week in Charlotte, Atlanta, Minneapolis, Irving TX, Chicago, or Cincinnati.

Job Description - Guardrails

The AI/ML Engineer is responsible for designing, developing, and deploying scalable AI solutions within an enterprise environment. The AI Engineer will design, build, and operate enterprise-grade integrations with frontier AI model providers, including OpenAI, Anthropic, and other emerging foundation model vendors. This role is responsible for enabling secure, scalable, and compliant direct model access across cloud and hybrid environments, developing APIs, SDKs, guardrails, observability capabilities, and orchestration frameworks that support production AI workloads. The engineer will evaluate and integrate new model releases, optimize performance, latency, reliability, and cost, and partner with architecture, security, risk, and platform engineering teams to establish standards for model governance, data protection, and responsible AI.

Basic Qualifications

• Minimum 5+ years of experience of hands-on expertise in LLM-based applications, GenAI architecture, and modern cloud-native engineering practices, focusing on specific vendor direct consumption (i.e.OpenAI, Anthropic).
• Minimum 5+ years of experience in large language models (LLMs)
• Minimum 5+ years of experience in prompt engineering
• Minimum 5+ years of experience in retrieval-augmented generation (RAG)
• Minimum 5+ years of experience in agentic workflows
• Minimum 5+ years of experience in model evaluation
• Minimum 5+ years of experience in driving technical innovation and accelerating adoption of advanced AI capabilities across the enterprise

NTT DATA provides a reasonable range of compensation for U.S.-based positions. The starting pay range for this role is [ 70- 75 W2 range]. Actual compensation will depend on a number of factors, including the candidate's relevant experience, technical skills, and other qualifications. This position is eligible for company benefits including participation in medical, dental, and vision insurance, flexible spending or health savings account, and AD&D insurance, employee assistance, participation in a 401k program, and additional voluntary or legally-required benefits.

Degree: Bachelors in Computer Science or equivalent work experience

About NTT DATA

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future. Visit us at us.nttdata.com

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.