Principal AI Architect & Tech Visionary

Insight Global; City of Albany (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

Insight Global is seeking a Principal AI Software Engineer to support a global client and drive technical vision for enterprise AI applications. You will integrate LLMs, agent workflows, NLP, CV, and analytics while ensuring high availability and cost efficiency.

You’ll partner with product, data science, and engineering leaders, mentor teams, and raise standards in Agile, testing, security, and documentation. We support growth, autonomy, and collaboration across research and product.

Qualifications

• Bachelor’s degree in Computer Science, Computer Engineering, or related technical field.
• 10+ years of programming experience with modern front-end frameworks and multiple back-end languages.
• Proven track record shipping production AI apps with LLMs at scale.
• Experience with vector databases and embedding model optimization.
• Expertise with multiple LLM providers and orchestration frameworks.
• Extensive experience leading technical teams and cross-team initiatives.
• Expert-level experience with cloud platforms and containerization (EKS).

Responsibilities

• Set AI architecture and technical vision across products.
• Lead cross-team initiatives with product and data science.
• Design RAG and agent workflows; optimize LLM integrations.
• Build multi-tenant, high-availability systems with observability.
• Establish AI cost management, monitoring, and security standards.

Skills

LLM integrations

AI architecture

Python & Java

Frontend frameworks

Mentorship

Cloud platforms

Education

Bachelor’s degree in CS/CE

Tools

Milvus

Pinecone

Weaviate

pgvector

LangChain

LlamaIndex

EKS

AWS

GCP

Azure

Job description

Insight Global is seeking a Principal AI Software Engineer to support a global client and drive technical vision for enterprise AI applications. You will integrate LLMs, agent workflows, NLP, CV, and analytics while ensuring high availability and cost efficiency.

You’ll partner with product, data science, and engineering leaders, mentor teams, and raise standards in Agile, testing, security, and documentation. We support growth, autonomy, and collaboration across research and product.