AI Platform Engineer - Internal Tools & Compliance

aalyria-careers; San Francisco (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

401(k)

Dental

Vision

Health insurance

Life Insurance

PTO

Equity

Job summary

Aalyria is hiring a software engineer to build the AI layer of our engineering organization. This role focuses on designing, shipping, and operating internal AI products and platform services atop our cloud infrastructure (GCP, GKE, Vertex AI, GitLab).

You will work within a regulated environment (CMMC, DoD IL, FedRAMP) assessing constraints with security and compliance and delivering auditable, maintainable integrations that scale with our engineers’ needs.

Qualifications

• Strong software engineering fundamentals across production systems.
• Hands-on experience building LLM-powered systems including retrieval, tool use, and agent orchestration.
• Product sense for internal tooling and experience deploying/open-source frontends.
• Developer-platform integration with Git-hosting APIs, webhooks, and CI/CD.
• Cloud and Kubernetes engineering with hands-on infrastructure work.

Responsibilities

• Define and build AI platform components including chat frontends, MCP/RAG services, and code execution sandboxes.
• Architect and operate end-to-end AI integrations on top of GCP/GKE/Vertex AI/GitLab.
• Ensure observability, telemetry, and cost attribution for AI model usage.
• Collaborate with security/compliance to translate constraints into system design and guardrails.
• Maintain and monitor the AI stack, perform upgrades and incident response.

Skills

Software engineering fundamentals

LLM-powered systems

Internal tooling product sense

Developer-platform integration

Cloud & Kubernetes engineering

Sandboxing & isolation

Regulated environment understanding

Written communication

Autonomy

Tools

Python

Go

TypeScript

Terraform

GKE

Vertex AI

GitLab

Kubernetes

Job description

Aalyria is hiring a software engineer to build the AI layer of our engineering organization. This role focuses on designing, shipping, and operating internal AI products and platform services atop our cloud infrastructure (GCP, GKE, Vertex AI, GitLab).

You will work within a regulated environment (CMMC, DoD IL, FedRAMP) assessing constraints with security and compliance and delivering auditable, maintainable integrations that scale with our engineers’ needs.