Principal AI Architect & Hands-On Technical Lead (1162792)

The Judge Group

Dublin (CA)

Hybrid

USD 185,000 - 210,000

Full time

41 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical, dental, and vision insurance
401(k) retirement plan
Paid time off and holidays
Professional development opportunities
Collaborative, entrepreneurial culture
Access to cutting-edge AI tech

Job summary

The Judge Group seeks a Principal AI Architect & Technical Lead to architect, build, and lead full-lifecycle AI/ML product development. You will drive data engineering, model training, GenAI integration, and intelligent deployments while writing production-grade code.

You will lead high-performing AI and software teams, set technical vision, and ensure governance, security, and cost optimization. Hybrid role based in CA with exposure to cutting-edge AI initiatives.

Qualifications

  • 10+ years of software/ML engineering experience.
  • 5+ years leading engineering teams and architecture initiatives.
  • Proven track record deploying production AI/ML systems.
  • Deep expertise with Generative AI, LLMs, agentic AI, and MLOps.

Responsibilities

  • Architect end-to-end ML systems including data pipelines and monitoring.
  • Build scalable cloud-native applications leveraging foundation models and RAG.
  • Lead and mentor AI/ML engineers and software developers.
  • Guide decisions to deliver AI initiatives from concept to production.

Skills

AI architecture
Leadership
GenAI
MLOps
Cloud-native

Education

Bachelor's degree in CS/related field

Tools

BigQuery
Dataflow
Apache Beam
TensorFlow
PyTorch
Scikit-learn
React
Angular
Kubernetes
GitHub Actions

Job description

  • Apache Airflow

Location: Dublin, CA

Salary: $185,000.00 USD Annually - $210,000.00 USD Annually

Principal AI Architect & Technical Lead

Location: Pleasanton, CA (Hybrid)

Salary: 185,000-$210,000

About The Opportunity

We are seeking a Principal AI Architect & Technical Lead to architect, build, and lead full-lifecycle AI/ML product development, from data engineering and model training through GenAI integration and intelligent application deployment.

This is an end-to-end leadership role for a hands-on builder who thrives on writing production code, deploying machine learning systems, integrating large language models (LLMs), and leading high-performing teams of AI and software engineers. The ideal candidate combines deep technical expertise with strategic leadership to deliver innovative, scalable AI solutions.

What You'll Do
Architect & Build AI Solutions
  • Design and develop end-to-end machine learning systems, including data pipelines, feature stores, training environments, inference services, and monitoring frameworks.
  • Architect scalable, cloud-native applications that leverage foundation models, Retrieval-Augmented Generation (RAG), and agentic AI workflows.
  • Develop secure, privacy-focused machine learning solutions aligned with industry compliance and data governance requirements.
  • Create explainable AI frameworks that provide transparency and trust in model outputs.
  • Design multi-tenant AI architectures that ensure data isolation, scalability, performance, and reliability.
Hands-On Engineering
  • Build and maintain robust data pipelines using BigQuery, Dataflow, Apache Beam, and related technologies.
  • Train, optimize, and deploy machine learning models using TensorFlow, PyTorch, and Scikit-learn.
  • Develop full-stack AI-powered applications using Python, Java, React, Angular, and cloud-native services.
  • Implement MLOps practices that support reproducible training, CI/CD automation, model monitoring, and cost-effective scaling.
Generative AI & Agent Development
  • Build and integrate GenAI capabilities including semantic search, knowledge retrieval, intelligent Q&A, summarization, conversational AI, and synthetic data generation.
  • Design and develop AI agents and copilots using tools such as LangChain, CrewAI, Vertex AI, and related frameworks.
  • Develop domain-specific LLM applications leveraging vector databases including FAISS and Pinecone.
  • Prototype and deploy multi-agent systems that streamline complex business processes and decision-making workflows.
Technical Leadership
  • Lead and mentor a team of AI engineers, machine learning engineers, and software developers.
  • Define technical vision, architecture standards, and engineering best practices.
  • Partner with Product, Data Science, and Executive Leadership teams to drive AI strategy and innovation.
  • Guide architectural decisions and ensure successful delivery of AI initiatives from concept to production.
Required Qualifications
  • 10+ years of experience in software engineering, machine learning engineering, or related fields.
  • 5+ years of experience leading engineering teams and technical architecture initiatives.
  • Proven success designing, building, and deploying production-scale AI/ML applications.
  • Deep expertise with Generative AI technologies, LLM frameworks, agentic AI architectures, and MLOps practices.
  • Experience operationalizing enterprise AI solutions, including governance, security, monitoring, and cost optimization.
  • Demonstrated track record of delivering innovative products at scale.
  • Strong communication, leadership, and cross-functional collaboration skills.
Preferred Technical Skills
Programming Languages & Frameworks
  • Python
  • Java
  • SQL
  • JavaScript / TypeScript
  • TensorFlow
  • PyTorch
  • Scikit-learn
  • React
  • Angular
Cloud Platforms
  • Google Cloud Platform (GCP)
  • Vertex AI
  • BigQuery
  • Cloud Functions
  • Cloud Run
  • Dataflow
  • Pub/Sub
  • Oracle Cloud Infrastructure (OCI)
  • OCI Data Science
  • Autonomous Data Warehouse
  • OCI Functions
  • Oracle Kubernetes Engine (OKE)
  • Data Flow
  • Streaming
Data & MLOps
  • BigQuery
  • AlloyDB
  • MongoDB
  • Redis
  • MLflow
  • Kubeflow
  • Apache Airflow
  • Docker
  • Kubernetes
  • GitHub Actions
  • Terraform
Generative AI & Agent Frameworks
  • Vertex AI Gemini
  • OpenAI
  • Claude
  • LangChain
  • LlamaIndex
  • FAISS
  • Pinecone
  • RAG Architectures
  • Multi-Agent Systems
  • Prompt Engineering & Orchestration
Developer Tools
  • GitHub Copilot
  • ChatGPT
  • Cursor AI
  • Locofy
Competitive compensation packages and benefits depending on location and position,
  • Comprehensive medical, dental, and vision insurance
  • 401(k) retirement savings plan
  • Paid time off and company‑recognized holidays
  • Professional development and career growth opportunities
  • Collaborative, innovative, and entrepreneurial work environment
  • Exposure to cutting‑edge AI technologies and high‑impact initiatives
  • Opportunity to make a meaningful contribution to a growing organization

If you're passionate about building transformative AI products and leading world‑class engineering teams, we'd love to hear from you.

Medical, dental, and vision insurance are available to qualified candidates who meet eligibility requirements.

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Contact:

jprovenzano@judge.com

This job and many more are available through The Judge Group. Find us on the web at www.judge.com

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Technical Lead - AI Platform (1158228)
Technical Lead - AI Platform (1158228)

The Judge Group • Charlotte (NC)

Hybrid
USD 200,000 - 225,000
Sr. AI Developer (1160401)
Sr. AI Developer (1160401)

The Judge Group • United States

Remote
USD 96,000 - 110,000
Medical insurance
Remote work
Senior AI Architect & Hands-On Tech Lead (GenAI)
Senior AI Architect & Hands-On Tech Lead (GenAI)

The Judge Group • Dublin (CA)

Hybrid
USD 185,000 - 210,000
Medical, dental, and vision insurance
401(k) retirement plan
Paid time off and holidays
+3
Customer Success Manager (Remote-USA)
Customer Success Manager (Remote-USA)

DeepJudge • United States

Remote
USD 125,000 - 175,000
Equity opportunity
Remote work
Director - AI and Data (Energy) (1158552)
Director - AI and Data (Energy) (1158552)

The Judge Group • McLean (VA)

On-site
USD 138,000 - 172,000
Medical insurance
Dental insurance
Vision insurance
Customer Success Manager (Remote-USA)
Customer Success Manager (Remote-USA)

DeepJudge AG • United States

Remote
USD 125,000 - 175,000
Remote work within a global company
Competitive salary and incentives
Equity opportunities
+1
Member of Technical Staff, Applied AI
Member of Technical Staff, Applied AI

GC AI • San Mateo (CA)

Hybrid
USD 180,000 - 240,000
Competitive salary
Equity
Healthcare
+1
Senior Machine Learning Engineering Manager
Senior Machine Learning Engineering Manager

Judi Health • Denver (CO), New York (NY), Charlotte (NC)

Hybrid
USD 174,000 - 218,000
Senior Machine Learning Engineer
Senior Machine Learning Engineer

Arionkoder • United States

Remote
USD 150,000 - 230,000
Monthly USD Service Fee
Paid Agreed Time Off
Caregiver Time Off
+2
AI Engineer
AI Engineer

Imigrus • Plano (TX)

On-site
USD 140,000 - 180,000