AI Solution Architect

Delta System & Software, Inc.; New York (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

Delta System & Software, Inc. in New York, NY seeks an experienced AI Solution Architect to architect and deliver enterprise-grade AI/ML, Generative AI, and Agentic AI solutions.

You will translate complex business requirements into secure, scalable, production-ready specifications while guiding architecture decisions and governance. You will lead design of cloud-native, distributed AI solutions across AWS, Azure, and Google Cloud, integrating LLMs, embeddings, vector databases, and data

Qualifications

• Experience designing enterprise AI solu­tions in cloud environments.
• Hands-on AI engineering with a focus on scalable, secure architectures.
• Ability to translate business requirements into technical specs.

Responsibilities

• Architect end-to-end AI solutions spanning data ingest, model integration, retrieval, orchestration, deployment, and governance.
• Design Generative AI, RAG, and Agentic AI architectures with memory and guardrails.
• Evaluate LLM/SLM choices based on security, latency, and cost.
• Define enterprise security controls and regulatory compliance for AI systems.
• Lead architecture reviews, create reference architectures, and mentor teams.
• Drive Spec-Driven Engineering across the lifecycle with testable specs.

Skills

ML & DL

Generative AI

LLMs/SLMs

Prompt engineering

Python

PyTorch/TensorFlow

LangChain

Azure/AWS/Vertex

MLOps/LLMOps

Kubernetes

REST/GraphQL

Security & governance

Tools

PyTorch

TensorFlow

Hugging Face

LangChain

LangGraph

CrewAI

Spark

Kafka

Airflow

Docker

Kubernetes

Terraform

CI/CD

MLflow

Job description

Location: Manhattan, NY (NY/ NJ talents are preferred)

Job Type: Full time permanent

We are looking for an experienced AI Solution Architect to architect and deliver enterprise-grade AI/ML, Generative AI, and Agentic AI solutions using Spec-Driven Engineering practices. The role requires a combination of strong architecture expertise, hands-on AI engineering knowledge, cloud-native solution design, and the ability to translate complex business requirements into secure, scalable, production-ready AI solutions through clear, testable, and traceable specifications.

Required Skills

• Strong understanding of Machine Learning, Deep Learning, Generative AI, LLMs/SLMs, RAG, Agentic AI, prompt/context engineering, embeddings, vector search, structured outputs, and AI evaluation techniques.
• Strong hands-on knowledge of Python and AI/ML frameworks such as PyTorch, TensorFlow, Hugging Face, LangChain, LangGraph, or CrewAI.
• Experience with enterprise AI and cloud platforms such as Azure AI Foundry/Azure Machine Learning, AWS SageMaker and related AWS AI services, or Google Vertex AI.
• Knowledge of SQL, NoSQL, vector databases, graph databases, knowledge graphs, and data/platform technologies such as Kafka, Spark, and Airflow.
• Experience with cloud-native engineering and MLOps/LLMOps, including Docker, Kubernetes, Terraform, CI/CD, GitOps, MLflow or equivalent lifecycle and observability platforms.
• Strong understanding of REST/GraphQL APIs, microservices, event-driven architectures, distributed systems, enterprise integration patterns, and architecture for security, privacy, resiliency, scalability, performance, observability, and cost optimization.
• Experience with Spec-Driven Engineering, including requirements decomposition, architecture and API specifications, executable acceptance criteria, specification-to-code/test traceability, version control, and AI-assisted engineering workflows.
• Strong client-facing solutioning, stakeholder management, technical leadership, architecture documentation, and communication skills, with experience designing AI solutions for regulated industries.
• Knowledge of knowledge graphs, ontologies and Graph-RAG architectures

Key Responsibilities

• Architect end-to-end enterprise AI solutions spanning data ingestion, model/LLM integration, retrieval, orchestration, application integration, deployment, evaluation, monitoring, and governance.
• Design Generative AI, RAG, and Agentic AI solutions.
• Define Agentic AI architectures incorporating agent orchestration, tool/API integration, context and memory management, human-in-the-loop controls, guardrails, evaluation, and observability.
• Evaluate and select appropriate LLMs, SLMs, embedding models, AI frameworks, retrieval approaches, and deployment patterns based on accuracy, latency, security, scalability, and cost.
• Architect AI solutions using services across AWS, Microsoft Azure, and Google Cloud, with deep expertise in at least one hyperscaler.
• Design cloud-native and distributed architectures using APIs, microservices, event-driven patterns, containers, and Kubernetes.
• Define enterprise AI security and governance controls covering identity and access, data privacy, responsible AI, model security, auditability, and regulatory requirements.
• Lead solution discovery, architecture definition, technical assessments, POCs, reference architectures, reusable accelerators, and productionization.
• Drive Spec-Driven Engineering across the AI solution lifecycle by translating business intent, architecture decisions, functional and non-functional requirements, interfaces, guardrails, and acceptance criteria into version-controlled, machine-consumable specifications that guide design, code generation, testing, validation, and deployment.
• Partner with business stakeholders, enterprise architects, product teams, data scientists, AI engineers, DevOps/platform teams, and security teams.
• Provide technical leadership, conduct architecture/design reviews, mentor engineering teams, and communicate solution trade-offs to technical and executive stakeholders.