AI Architect Lead Consultant

Socket.dev; Philadelphia (Philadelphia County); On-site; USD 150,000 - 230,000; Full time

Job summary

NTT DATA is seeking an AI Architect Lead Consultant in Philadelphia to lead AI projects from conception to deployment across industries. You will design major components, act as technical lead, and mentor team members, with hands-on work about 70% of the time.

The role covers ML, NLP, CV, intelligent automation, and Generative AI, with emphasis on secure-by-design practices. The position requires extensive experience in AI/ML solutions, production deployments, and multi-model deployment

Qualifications

• Bachelor’s degree in computer science, engineering, data science, information systems, or related technical discipline.
• 8+ years in software engineering, cloud, data engineering, AI/ML, architecture, or enterprise tech delivery.
• 4+ years designing and delivering production AI/ML solutions.
• 1+ years delivering production Generative AI or LLM-based systems, including LLM APIs, RAG, embeddings, vector/graph retrieval, evaluation, guardrails, and agentic workflows.
• 5+ years in software engineering with proficiency in at least one language — Python, Java, C#, C++, TypeScript/JavaScript, Go, or equivalent.
• 2+ years architecting AI solutions across multiple deployment models and establishing operational practice for AI systems.

Responsibilities

• Lead AI projects from conception through deployment.
• Translate business challenges into AI solution designs and evaluate business impact.
• Design and implement major components of enterprise AI solutions.
• Build AI solution patterns across ML and GenAI (LLM apps, RAG, embeddings, vectors, retrieval).
• Prepare data and feature engineering for AI workloads.
• Develop prototypes, proofs of concept, and production-ready AI services.
• Optimize models and inference workloads for performance and cost.
• Design data storage strategies for AI workloads across databases and data lakes.
• Apply secure-by-design practices and data governance requirements.
• Implement responsible‑AI controls and monitoring.
• Mentor engineers and contribute to reusable patterns and playbooks.

Skills

AI architecture

Python

LLM/GenAI

Cloud platforms

API design

MLOps

Distributed computing

Education

Bachelor’s degree in CS/engineering/data science

Master’s degree in AI/ML (preferred)

Tools

REST

gRPC

CI/CD

Infrastructure as Code

Job description

Req ID:390701

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization.

We are currently seeking a AI Architect Lead Consultant to join our team in Philadelphia, Pennsylvania (US-PA), United States (US).

Role Summary

As an AI Architect at Lead Consultant level, you will lead AI projects from conception through deployment for clients across industries, translating business challenges into working AI solutions. You will design and build the major components of those solutions, and act as the technical lead for the workstreams you own within a client engagement.

The role spans the AI lifecycle — from discovery and solution design through proof of concept, production implementation, and operational improvement. The scope includes machine learning, predictive analytics, natural language processing, computer vision, intelligent automation, and Generative AI.

This is a hands-on architecture role. Expect roughly 70% of your time hands-on — building reference implementations, prototypes, production services, and integration work — and roughly 30% on design, technical leadership, and mentoring. Engagement models vary, and some client contexts require sustained hands‑on delivery alongside the engineering team.

Key Responsibilities

• Lead assigned AI projects from conception through deployment, owning design and delivery for the workstreams you are accountable for.


• Translate business challenges into AI solution designs, and evaluate the business impact and expected return of the approaches you propose.


• Design and implement major components of enterprise AI solutions across applications, integration, data, AI/ML, and infrastructure.


• Design and build AI solution patterns across ML and GenAI — LLM applications, retrieval-augmented generation, agents, orchestration, embeddings, vector and graph-based retrieval, model integrations, and evaluation.


• Conduct data preprocessing, feature engineering, and dataset preparation for AI workloads.


• Build prototypes, proofs of concept, reference implementations, and production-ready AI services.


• Optimize AI models and inference workloads for performance, scalability, and cost, including on distributed computing frameworks and AI-optimized hardware.


• Design data storage and retrieval approaches for AI workloads across databases, data lakes, and vector or graph stores.


• Apply secure-by-design practices — authentication, RBAC, secrets management, encryption, private networking, data protection, auditability, and authorization-aware data retrieval.


• Implement responsible‑AI controls, including content safety, PII protection, bias identification and mitigation, prompt‑injection defenses, and human review.


• Work within client data governance requirements and applicable data privacy regulation in everything you design and deliver.


• Apply MLOps, LLMOps, and GenAIOps practices — CI/CD, version control, model and prompt versioning, infrastructure as code, testing, evaluation, monitoring, tracing, and lifecycle management.


• Communicate AI concepts, design decisions, and trade-offs clearly to client technical, product, and business teams, and collaborate across delivery, data, infrastructure, and security functions to integrate AI solutions.


• Mentor engineers and junior team members in AI engineering and architecture practices.


• Contribute to reusable patterns, accelerators, and delivery playbooks; stay current with emerging AI technologies; and provide technical input to discovery workshops, solution shaping, and effort estimates.

Basic Qualifications

The experience periods below overlap and are not additive.

• Bachelor’s degree in computer science, engineering, data science, information systems, or a related technical discipline.


• 8+ years in software engineering, cloud, data engineering, AI/ML, architecture, or enterprise technology delivery.


• 4+ years designing and delivering production AI or ML solutions.


• 1+ years delivering production Generative AI or LLM-based systems, including LLM APIs, RAG, embeddings, vector and graph-based retrieval, evaluation, guardrails, and agentic workflows.


• 5+ years in software engineering with professional-level proficiency in at least one mainstream language — Python, Java, C#, C++, TypeScript/JavaScript, Go, or equivalent — including designing and integrating APIs and backend services using REST, gRPC, event-driven, or asynchronous patterns.


• 3+ years delivering technical design and implementation of significant components in complex enterprise environments.


• 2+ years architecting AI solutions across more than one deployment model (public cloud plus private cloud, hybrid, or on-premises) and establishing operational practice for AI systems — model and prompt versioning, artifact and experiment tracking, automated evaluation, monitoring and tracing, incident response, rollback — using CI/CD, infrastructure as code, and DevOps tooling.

Preferred Qualifications

• Master’s degree in AI/ML, computer science, engineering, data science, or a related field.


• 2+ years in consulting or professional services delivering technical solutions to external clients, including discovery workshops, solution shaping, effort estimation, and proposal input.


• 2+ years architecting secure enterprise systems — identity and authentication, authorization and RBAC, secrets management, encryption, network isolation, audit logging — and implementing responsible‑AI controls in production, including content safety, PII protection, prompt‑injection defenses, human review, and model risk management.


• Experience spanning Generative AI and one or more additional AI domains, such as classical ML, predictive analytics, NLP, computer vision, or intelligent automation.


• Experience across two or more major cloud AI platforms, including their managed model, retrieval, and orchestration services.


• Experience with container orchestration and GPU or accelerator infrastructure.


• Experience with model-serving and inference-optimization stacks, open-source or vendor, for self-hosted and private deployments.


• Experience with modern deep learning and classical ML frameworks, and the wider open-source model ecosystem.


• Experience with knowledge graphs, ontologies, semantic modelling, and graph databases, including graph-based or hybrid retrieval approaches for AI systems.


• Experience with model fine-tuning, quantization, evaluation, model routing, inference optimization, or deployment of open-source and proprietary models.


• Experience in AI governance, data privacy, security architecture, responsible AI, compliance, model risk, observability, and production AI operations.


• Relevant architecture, cloud, or AI certifications are welcome but not required.

Core Capabilities

Beyond the qualifications above, success in this role depends on:

Technical communication. Explaining design decisions and trade-offs clearly to delivery teams and client technical staff.

Influence. Building consensus within a delivery team and bringing others with you on technical decisions.

Developing others. Mentoring engineers and junior team members, and raising the standard of the work around you.

Judgment under ambiguity. Recognising which decisions need to be escalated and framing them well when they are.

About NTT DATA

NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners.NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&d.

Whenever possible, we hire locally to NTT DATA offices or client sites. This ensures we can provide timely and effective support tailored to each client’s needs. While many positions offer remote or hybrid work options, these arrangements are subject to change based on client requirements. For employees near an NTT DATA office or client site, in-office attendance may be required for meetings or events, depending on business needs. At NTT DATA, we are committed to staying flexible and meeting the evolving needs of both our clients and employees. NTT DATA recruiters will never ask for payment or banking information and will only use @nttdata.com, @nttdatafed.com and @talent.nttdataservices.com email addresses. If you are requested to provide payment or disclose banking information, please submit a contact us form, https://us.nttdata.com/en/contact-us.

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status. For our EEO Policy Statement, please click https://us.nttdata.com/en/contact-us. If you'd like more information on your EEO rights under the law, please click https://us.nttdata.com/en/contact-us. For Pay Transparency information, please click https://us.nttdata.com/en/contact-us.