Cloud & ML Infra Engineer — AI Flight Platform

AI Chopping Block; San Carlos (CA); Hybrid; USD 150,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Paid time off

401(k) plan

Job summary

Beacon AI is hiring a Cloud and ML Infrastructure Engineer in a hybrid role based in San Carlos, CA. You will lead AWS infrastructure, LLM endpoints, and data pipelines, collaborating with engineers and product teams to deploy scalable, secure AI services.

Ideal candidates design resilient systems, optimize costs, and implement robust observability. Expect hands-on work across ML infra, data orchestration, and edge-device connectivity in a fast-moving aviation-focused environment.

Qualifications

• Design, provision, and maintain AWS infra using IaC tools like CDK or Terraform.
• Build CI/CD and testing for apps, infra, and ML pipelines with GitHub Actions, CodeBuild, CodePipeline.
• Operate secure networking with VPCs, PrivateLink, and VPC endpoints; manage IAM, KMS, Secrets Manager, logging.
• Stand up model endpoints with Bedrock and/or SageMaker; evaluate ECS/EKS, Lambda, or Batch for inference.
• Develop services that call LLMs via clean APIs with streaming and batching.
• Implement prompt/tool flows with LangChain; support agent tools and function calling.
• Design chunking/embedding pipelines; orchestrate with Step Functions or Airflow.

Responsibilities

• Design, build, and maintain scalable cloud infrastructure for ML apps.
• Set up and operate LLM platforms and data pipelines end-to-end.
• Ensure security, observability, and cost governance across services.
• Collaborate with product and engineering to ship reliable features.
• Monitor performance, uptime, and incident response.

Skills

AWS

LLM Infra

Terraform

CI/CD

Python

LangChain

SageMaker

Bedrock

OpenSearch

Vector Search

Tools

GitHub Actions

CodeBuild

CodePipeline

VPC

IaC (CDK/ Terraform)

Glue

Athena

CloudWatch

Job description

Beacon AI is hiring a Cloud and ML Infrastructure Engineer in a hybrid role based in San Carlos, CA. You will lead AWS infrastructure, LLM endpoints, and data pipelines, collaborating with engineers and product teams to deploy scalable, secure AI services.

Ideal candidates design resilient systems, optimize costs, and implement robust observability. Expect hands-on work across ML infra, data orchestration, and edge-device connectivity in a fast-moving aviation-focused environment.