Remote AI Lab Infra Architect for Scalable Processing

Devopsroles; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

Berkeley Research Group (BRG) seeks an AI Infrastructure Engineer to lead the virtual Ai Lab access layer, enabling remote processing for BRG teams. You will design scalable cloud/on‑prem infrastructure, implement secure access, and optimize for large-scale document processing using state-of-the-art LLMs.

The role requires hands-on experience with IaC, AWS, and GPU-enabled AI workloads, plus leadership of critical projects from conception through production. On-site role with BRG’s AI department.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• 6–8 years of hands-on experience designing, deploying, and managing scalable cloud infrastructure.
• Experience with Infrastructure as Code (IaC) tools and methodologies.
• Experience designing, implementing, and maintaining scalable, secure, cost-efficient cloud/on-prem solutions.
• Proven ability to manage and lead projects to deliver high-quality, replicable solutions.
• Proficiency in Git/GitHub, Python, .NET, Java, SDLC, and CI/CD practices.
• Experience with API design and distributed systems.
• Knowledge of GPU infrastructure and optimization for AI workloads.
• Hands-on experience with AWS services including EC2, SageMaker, S3, Fargate/ECS/EKS, CDK, Terraform, Cost Explorer/Budgets.

Responsibilities

• Design and implement a virtual access layer for the physical Ai Lab infrastructure.
• Build scalable remote processing capabilities supporting 100,000+ documents per day.
• Create customizable, expandable interfaces for different BRG business units.
• Optimize infrastructure for maximum LLM token throughput (OpenAI/Anthropic).
• Implement secure authentication and access management systems.
• Ensure high availability and fault tolerance for mission-critical AI workloads.
• Lead infrastructure projects from conception to production deployment.

Skills

IaC practices

Cloud architecture

Project leadership

Security & access control

Education

Bachelor's degree in Computer Science / IT or related field

Tools

AWS

EC2

SageMaker

S3

Fargate/ECS/EKS

CDK

Terraform

Cost Explorer/Budgets

Git/GitHub

Python

Java

.NET

Job description

Berkeley Research Group (BRG) seeks an AI Infrastructure Engineer to lead the virtual Ai Lab access layer, enabling remote processing for BRG teams. You will design scalable cloud/on‑prem infrastructure, implement secure access, and optimize for large-scale document processing using state-of-the-art LLMs.

The role requires hands-on experience with IaC, AWS, and GPU-enabled AI workloads, plus leadership of critical projects from conception through production. On-site role with BRG’s AI department.