Lead AI Infrastructure Architect

GILLIG

Livermore (CA)

On-site

USD 180,000 - 225,000

Full time

11 days ago
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

GILLIG is seeking a Staff AI Infrastructure Architect to define and operate the cloud architecture behind AIO’s applications. Embedded within the AIO team, you will partner with GILLIG IT to set enterprise standards for deployment, security, and operation across data, compute, networking, model hosting, and security.

This hands-on role requires 7+ years of relevant experience, leadership in technical direction, and the ability to mentor engineers while balancing cost, reliability, and policy

Qualifications

  • BS degree in Engineering.
  • 8+ years in cloud, platform, DevOps or infra eng with architect/lead experience.
  • Hands-on with one major cloud (AWS or Azure) and knowledge of the other; Bedrock/Foundry hosting.
  • Designing, deploying, operating enterprise-scale cloud architectures.
  • IaC and CI/CD: Terraform, CloudFormation or Bicep.
  • Strong networking: VPC/VNet, hybrid connectivity, routing, firewalls.
  • Security focus: IAM, least privilege, secrets, encryption, compliance frameworks.
  • Experience deploying/operating LLM/AI services (Bedrock, OpenAI Foundry, SageMaker, etc.).
  • Ability to set direction, influence stakeholders, mentor engineers.
  • Containerization: Docker, Kubernetes, ECS, AKS.
  • Cloud architecture certifications preferred.

Responsibilities

  • Define target cloud architecture for data, compute, and networking and own it from design through operation.
  • Stand up and manage data services with data engineering.
  • Manage compute for dev, test, and production incl containerized/serverless hosting.
  • Design and maintain network connectivity: VPC/VNet, private connectivity, DNS, load balancing.
  • Host and manage LLM endpoints via Bedrock and Foundry, including quota and cost management.
  • Define and implement cybersecurity baseline: IAM, secrets, encryption, logging and patching.
  • Lead enterprise AI management: vendor selection, infrastructure strategy, guardrails and security standards.
  • Establish infrastructure as code and CI/CD pipelines, codified into templates.
  • Partner with IT to align with enterprise standards and security reviews.
  • Monitor cost, performance, reliability; own incident response for infra issues.
  • Mentor engineers on deployment practices and AI Fluency.

Skills

Cloud architecture
DevOps
Terraform
CI/CD
AWS
Azure
Networking
Security
LLM hosting
Kubernetes
Leadership
ECS / AKS
Cost management

Education

Bachelor's degree in Engineering

Tools

Terraform
CloudFormation
Bicep
AWS Bedrock
Azure AI Foundry
SageMaker
Docker
Kubernetes
ECS
AKS

Job description

The Artificial Intelligence Orchestration (AIO) team is responsible for how GILLIG puts artificial intelligence to work across the enterprise. We are committed to adopting AI thoughtfully and securely, growing the AI fluency of every organization we support, and delivering applications that make GILLIG faster, smarter, and easier to do business with. Our engineers are engaged in strategy, mentorship, and hands-on development across a wide range of business and technical areas, and the solutions we deliver serve both internal teams and external customers.

ABOUT THE ROLE

We are looking for a Staff AI Infrastructure Architect to define and operate the cloud architecture behind AIO’s applications. The position is embedded within the AIO team and partners closely with GILLIG IT, setting enterprise standards for how AI applications are deployed, secured, and operated. The work spans data, compute, networking, model hosting, and security, and this role leads the team’s enterprise AI management responsibilities, from vendor and platform strategy to guardrails and policy. This is a hands-on architecture role targeted at approximately 7 or more years of relevant experience.

IN THIS ROLE YOU WILL
  • Define the target cloud architecture for AIO applications across data, compute, and networking, and own it from design through operation
  • Stand up and manage data services (databases, storage, and pipelines) in partnership with data engineering
  • Manage compute for dev, test, and production environments, including containerized and serverless application hosting
  • Design and maintain network connectivity: VPC/VNet architecture, private connectivity to on-premise systems, DNS, and load balancing
  • Host and manage LLM endpoints via AWS Bedrock and Azure AI Foundry, including quota, cost, and access management
  • Define and implement the cybersecurity baseline: identity and access management, secrets management, encryption, logging and monitoring, and patching aligned to IT security standards
  • Lead the team’s enterprise AI management responsibilities: drive AI vendor selection, infrastructure strategy, guardrails, and AI security and policy standards
  • Establish infrastructure as code (e.g., Terraform) and CI/CD pipelines, and codify them into the team’s common deployment template
  • Partner with GILLIG IT to align architecture with enterprise standards, obtain buy-off on designs and deployments, and represent AIO in security and architecture reviews
  • Monitor cost, performance, and reliability of deployed applications and own incident response for infrastructure issues on the team’s products
  • Support Forward Deployed Engineers in moving proofs of concept to production quickly without compromising the security baseline
  • Mentor engineers on infrastructure and deployment practices and support the team’s AI Fluency mission across the company
BASIC QUALIFICATIONS
  • Bachelors of Science(BS) Degree in Engineering
  • Minimum 8 or more years of experience in cloud, platform, DevOps, or infrastructure engineering, including time as an architect or technical lead
  • Deep hands-on expertise in at least one major cloud (AWS or Azure) and strong working knowledge of the other; model hosting spans AWS Bedrock and Azure AI Foundry
  • Track record of designing, deploying, and operating production cloud architectures at enterprise scale
  • Expert-level infrastructure as code (Terraform, CloudFormation, or Bicep) and CI/CD practice
  • Strong networking foundation: VPC/VNet design, hybrid connectivity to on-premise systems, routing, firewalls, private endpoints
  • Strong security foundation: IAM, least privilege, secrets management, encryption, and experience implementing enterprise security or compliance frameworks (NIST CSF, SOC 2, CIS)
  • Experience deploying or operating LLM/AI services (Bedrock, Azure OpenAI / AI Foundry, SageMaker, or self-hosted model serving)
  • Demonstrated ability to set technical direction, influence senior stakeholders, and mentor engineers
  • Containerization and orchestration experience (Docker, Kubernetes, ECS, or AKS)
  • Cloud architecture certifications (AWS Solutions Architect Professional, Azure Solutions Architect Expert) preferred
WORK ENVIRONMENT
  • Ability to lift 25 lbs.
  • Prolonged periods of sitting/standing at a desk and working on a computer
  • Regularly required to sit, stand, and walk and occasionally kneel or squat
  • The ideal candidate must be able to complete all physical requirements of the job with or without a reasonable accommodation.
  • Must be able to navigate manufacturing environment, comfortable around heavy machinery, tools, etc.
  • Must be able to wear Personal Protective Equipment, (i.e. safety glasses, bump caps, hearing protection, etc.)
  • 5% travel may be required
  • Typical start time 7:00AM PST (negotiable)
EXPECTED COMPENSATION

$180,000 - $225,000/annual salary + premium benefits

Pay offered may vary depending on multiple individualized factors, including market location, job classification, job-related knowledge, skills, and experience. The total compensation package for this position may also include other elements dependent on the position offered. Details of participation in these benefit plans will be provided if a candidate receives an offer of employment

Please note this job description is not designed to cover or contain a comprehensive listing of activities, duties or responsibilities that are required of the employee for this job. Duties, responsibilities and activities may change at any time with or without notice.

GILLIG is committed to providing equal opportunities to all employees and applicants for employment. We are committed to creating an inclusive and diverse workplace that values and respects the unique talents, experiences, and perspectives of our employees and the people we serve. As an equal opportunity employer, we do not discriminate on the basis of race, color, religion, sex, national origin, age, disability, genetic information, sexual orientation, pregnancy, gender identity or any other characteristic protected by law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Infrastructure Architect — Cloud & Security
Senior AI Infrastructure Architect — Cloud & Security

GILLIG • Livermore (CA)

On-site
USD 180,000 - 225,000
UX Engineer
UX Engineer

GILLIG • Livermore (CA)

On-site
USD 120,000 - 160,000
AI Architect
AI Architect

theinformation-jobs • New York (NY)

On-site
USD 155,000 - 175,000
Medical, dental, and vision coverage
Fertility care benefits
Parental leave
+7
Lead AI Engineer
Lead AI Engineer

Talentify • Holmdel Township (NJ)

Hybrid
USD 110,000 - 180,000
AI Engineer
AI Engineer

Eliassen Group • Carson City (NV)

Remote
USD 124,000 - 152,000
Medical benefits
Dental benefits
Vision benefits
+2
Staff AI Engineer
Staff AI Engineer

Robots & Pencils • Houston (TX)

On-site
USD 177,000 - 210,000
Paid time off
Medical/dental/vision insurance
401(k)
AI Solutions Architect
AI Solutions Architect

Eliassen Group • Helena (MT)

Remote
USD 138,000 - 172,000
AI Engineer - Monitoring, Observability, and Governance
AI Engineer - Monitoring, Observability, and Governance

Bank of America • Pennington (NJ)

On-site
USD 103,000 - 180,000
Discretionary incentive eligible
Benefits eligible
AI Solutions Architect
AI Solutions Architect

Eliassen Group • Cheyenne (WY)

Remote
USD 138,000 - 172,000
Medical, Dental, Vision benefits
401k with company matching
Life insurance
AI Engineer - Monitoring, Observability, and Governance
AI Engineer - Monitoring, Observability, and Governance

Bank of America • Richmond (VA)

On-site
USD 103,000 - 180,000
Benefits eligible