Senior Cloud AI Infra Engineer — Hybrid in CA

Beacon AI; San Carlos (CA); Hybrid; USD 180,000 - 240,000; Full time

Benefits offered by this job

Healthcare: 100% of employee premiums

PTO 3 weeks + 13+ holidays

401(k) plan

Job summary

Beacon AI in San Carlos, CA is seeking a Senior Software Engineer, Cloud Infrastructure to lead the buildout of our AWS foundation and the LLM platform. You will design, implement, and operate services that are scalable, reliable, and secure.

The broad scope includes LLM/ML Infra and IoT infra as strong bonus points. You will work closely with engineers and product management, taking ownership and building from first principles.

Qualifications

• Design, provision, and maintain AWS infrastructure with IaC.
• Build CI/CD pipelines for apps, infra, and ML workflows.
• Implement secure networking, IAM, and auditing practices.
• Deploy and operate LLM endpoints using Bedrock/SageMaker.

Responsibilities

• Design, provision, and maintain AWS infrastructure using IaC (CDK/Terraform).
• Develop CI/CD and testing for apps, infra, and ML pipelines (GitHub Actions, CodeBuild, CodePipeline).
• Operate secure networking (VPCs, PrivateLink, IAM, KMS, Secrets Manager).
• Stand up and operate LLM endpoints (Bedrock/SageMaker); evaluate ECS/EKS/Lambda for inference.

Skills

Cloud Infrastructure

LLM/ML Infra

Python

Security

IoT Infra

AWS

Tools

AWS CDK

Terraform

GitHub Actions

CodeBuild

CodePipeline

SageMaker

Bedrock

LangChain

OpenSearch

pgvector

Glue

Athena

Job description

Beacon AI in San Carlos, CA is seeking a Senior Software Engineer, Cloud Infrastructure to lead the buildout of our AWS foundation and the LLM platform. You will design, implement, and operate services that are scalable, reliable, and secure.

The broad scope includes LLM/ML Infra and IoT infra as strong bonus points. You will work closely with engineers and product management, taking ownership and building from first principles.