LLM Platform Architect

SAIC; Virginia (MN); Remote; USD 160,000 - 200,000; Full time

Job summary

SAIC seeks an experienced LLM Platform Architect to lead the design of a scalable AI/ML ecosystem. The role encompasses developing enterprise-level platform strategies and requires significant expertise in LLM integration and AI infrastructure. Candidates should have a strong background in multi-cloud architecture and compliance alignment. This full-time position offers a competitive salary range.

Qualifications

• 10+ years of experience designing platform architecture.
• Expertise in large language model integration.
• Deep understanding of AWS services and infrastructure automation.

Responsibilities

• Architect secure, scalable environments for model development.
• Establish CI/CD and infrastructure-as-code pipelines.
• Collaborate with infrastructure and cybersecurity teams.

Skills

AI/ML infrastructure

Platform architecture

Cloud services

API integration

Compliance alignment

Education

Bachelor’s or master’s degree in computer science, Engineering

Tools

Terraform

Databricks

JupyterHub

AWS SageMaker

Bedrock

Job description

Join to apply for the LLM Platform Architect role at SAIC

5 days ago Be among the first 25 applicants

Join to apply for the LLM Platform Architect role at SAIC

Get AI-powered advice on this job and more exclusive features.

Minimum Clearance Required None

Job ID 2506494

Location REMOTE WORK, VA, US

Date Posted 2025-06-09

Category Information Technology

Subcategory Platform Engr

Schedule Full-time

Shift Day Job

Travel No

Minimum Clearance Required None

Clearance Level Must Be Able to Obtain Public Trust

Potential for Remote Work Yes

Description

We are seeking a highly experienced Platform Architect with expertise in LLM (Large Language Model) integration and AI/ML platform engineering to lead enterprise-level platform strategy and architecture. This role is centered on designing a scalable, modular, and secure AI/ML ecosystem that integrates seamlessly across enterprise teams—including infrastructure, governance, and security organizations.

You will guide the end-to-end architecture of a multi-cloud AI/ML platform that supports mission-critical workloads across federal, state, and commercial programs. The platform integrates services like Databricks, JupyterHub, AWS SageMaker, Bedrock, and emerging tools, while adhering to stringent security, compliance, and operational oversight frameworks. The role requires deep systems-level thinking with the ability to align technical direction with enterprise stakeholder needs.

Key Responsibilities

• Architect secure, scalable environments for enterprise-grade model development and GenAI integration, including foundational components such as Databricks, JupyterHub, SageMaker, Bedrock, and future LLM-as-a-service frameworks.
• Establish enterprise-ready CI/CD and infrastructure-as-code pipelines using Terraform, Bitbucket, Bamboo, supporting platform repeatability, compliance, and modular growth.
• Collaborate closely with enterprise infrastructure, cybersecurity, governance, and data architecture teams to ensure alignment with boundary controls, policy enforcement, and integration patterns.
• Lead the development of platform-wide architecture artifact system blueprints, integration diagrams, standards repositories, onboarding workflows, and internal guidance consumed by implementation teams.
• Design future-ready cross-cloud integration architectures across AWS (T-Cloud), Azure, GCP, and OCI to support federated model workloads and portability of GenAI services.
• Represent architectural direction in executive and stakeholder reviews while partnering with internal product, security, and compliance teams to ensure platform continuity.
• Evaluate and define mechanisms to onboard additional tooling or frameworks (e.g., Immuta, Trustworthy AI audit services) to extend core platform capabilities while preserving auditability and operational control.
• Guide engineering teams with design best practices and influence long-term platform evolution strategies to maintain velocity, reusability, and governance.
  
  

Qualifications

Required Qualifications

• Bachelor’s or master’s degree in computer science, Engineering, or a related technical field.
• 10+ years of experience designing platform architecture, including hands-on experience with AI/ML infrastructure.
• Must be a U.S. Citizen with the ability to obtain and maintain a Public Trust clearance.
• Demonstrated experience building enterprise-scale, modular platforms across hybrid or multi-cloud ecosystems.
• Deep understanding of AWS services (S3, Lambda, RDS, SageMaker, Bedrock), Databricks, and infrastructure automation (Terraform).
• Experience working with enterprise governance, compliance, and security stakeholders to align platform design with organizational and regulatory requirements.
• Strong ability to define patterns for API integration, model deployment, lifecycle orchestration, and cloud-native operations.
  
  

Desired Skills

• Knowledge of GenAI patterns, LLM evaluation pipelines, and Responsible AI enforcement mechanisms.
• Experience working within government enterprise environments with boundary protection, audit, and compliance constraints.
• Familiarity with platform compliance standards (FedRAMP, NIST 800-53, SOC2) and model ATO strategies.
• Excellent communication and leadership skills to work across enterprise architecture forums and executive planning sessions.
  
  

Target salary range $160,001 - $200,000. The estimate displayed represents the typical salary range for this position based on experience and other factors.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Engineering and Information Technology

• Industries

  Computer Hardware Manufacturing, Defense and Space Manufacturing, and IT Services and IT Consulting

Referrals increase your chances of interviewing at SAIC by 2x

Sign in to set job alerts for “Platform Architect” roles.

Virginia, United States $194,000.00-$212,000.00 2 weeks ago

Virginia, United States $81,045.75-$201,088.80 2 weeks ago

Virginia Beach, VA $60.00-$110.00 2 weeks ago

Senior Cloud Solutions Architect/Engineer

Virginia, United States $207,400.00-$335,500.00 2 weeks ago

Charlottesville, VA $131,800.00-$164,700.00 1 day ago

Reston, VA $99,216.00-$206,369.00 1 month ago

Fairfax, VA $92,118.00-$202,730.00 2 days ago

Arlington, VA $90,000.00-$105,000.00 2 months ago

Cloud Senior Solutions Architect (FedRAMP) (4077)

Herndon, VA $126,200.00-$210,400.00 1 week ago

Senior Architect, Security, Field CTO Office

Fairfax, VA $92,118.00-$202,730.00 2 days ago

Principal Solutions Architect Aviation, Project Kuiper Mobility Team

Sailpoint IdentityNow Solutions Architect Consultant (*Must have own tenant in IDN*)- 100% REMOTE

Virginia Beach, VA $85.00-$110.00 4 days ago

BigCommerce Developer/Lead/Architect (Remote)

Fractional ServiceNow Solution Architect (Remote DC MD VA)

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.