Lead AI/ML Architect — Enterprise LLM & RAG

Valiant Technologies LLC; City of Albany (NY); On-site; USD 78,000 - 112,000; Full time

Job summary

Valiant Technologies LLC in Albany, NY seeks a Lead AI/ML Architect to design and operationalize AI capabilities at enterprise scale. You will architect AI workflows, deploy LLM-based solutions, and drive responsible AI governance across Finance, Data Engineering, and Security teams.

The role emphasizes building scalable AI products, prompt strategies, and robust evaluation frameworks, collaborating with cross-functional stakeholders to deliver trusted AI solutions.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Data Science, or related field; equivalent experience considered.
• Significant experience in software engineering, machine learning, or AI engineering.
• Hands-on experience building and deploying generative AI and LLM-based applications in production environments.
• Experience with prompt engineering, RAG architectures, AI agents, model evaluation, and operational AI governance.
• Strong understanding of cloud-native architectures, APIs, data platforms, and scalable software systems.
• Knowledge of Responsible AI, security, privacy, and compliance practices.
• Proven ability to work effectively with technical and business stakeholders.

Responsibilities

• Design AI solution architectures aligned with business objectives, risk tolerance, and governance requirements.
• Build and deploy LLM workflows, prompt orchestration chains, agent-based solutions, RAG applications, model integrations, classification models, and decision-support capabilities.
• Develop prompt strategies, grounding approaches, tool-calling patterns, guardrails, and fallback mechanisms to improve solution quality and reliability.
• Partner with Data Engineering teams to ensure access to trusted, governed data sources.
• Establish evaluation frameworks, test datasets, scoring rubrics, and model-performance benchmarks.
• Monitor and optimize output quality, relevance, accuracy, consistency, latency, cost efficiency, and hallucination risk.
• Conduct failure-mode analysis and implement continuous improvements to AI systems.
• Collaborate with Quality Engineering, Responsible AI, Security, Privacy, Compliance, and Enterprise Architecture teams.
• Document AI solution behavior, limitations, controls, and operational monitoring requirements.
• Support production readiness through observability, monitoring, model evaluation, and drift detection practices.

Skills

AI engineering

Machine Learning

Software engineering

Prompt engineering

RAG architectures

AI agents

Model evaluation

Governance

Education

Bachelor's degree in Computer Science/Engineering/Data Science

Job description

Valiant Technologies LLC in Albany, NY seeks a Lead AI/ML Architect to design and operationalize AI capabilities at enterprise scale. You will architect AI workflows, deploy LLM-based solutions, and drive responsible AI governance across Finance, Data Engineering, and Security teams.

The role emphasizes building scalable AI products, prompt strategies, and robust evaluation frameworks, collaborating with cross-functional stakeholders to deliver trusted AI solutions.