Software Engineer - Infrastructure (Mid - Senior)

Julius AI; San Francisco (CA); On-site; USD 150,000 - 200,000; Full time

Benefits offered by this job

Health & dental insurance

Gym reimbursement

Daily team meals

Commuter benefits

Job summary

Julius AI in San Francisco is seeking a skilled engineer to build and scale the code-execution sandboxes that power its AI solutions. You will design secure, multi-tenant container infrastructures while ensuring performance and reliability across AWS and GCP cloud environments.

The ideal candidate has a strong background in Kubernetes, cloud services, and container security best practices. Position offers competitive compensation ranging from $150K to $200K, along with health benefits and equity opportunities.

Qualifications

• Strong networking fundamentals.
• Experience with IaC (Infrastructure as Code).
• Familiarity with observability tools.

Responsibilities

• Design and operate secure, multi-tenant container infrastructure.
• Ship cloud deployments with SSO and audit logging.
• Drive observability with clear SLOs.

Skills

Production Kubernetes and container internals

Cloud (AWS/GCP/Azure)

Monitoring/Logging (Prometheus, Grafana, OpenTelemetry)

Security best practices for containerized systems

Tools

Terraform

Helm

Job description

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes (isolated remote containers) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

Compensation

Competitive base salary and meaningful equity

Benefits

Health & dental insurance, gym reimbursement, daily team meals, commuter benefits

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

• Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.
• Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.
• Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.
• Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

• Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.
• Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).
• Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).
• Security best practices for containerized, multi‑tenant systems.

Nice to Have

• gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).
• You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Compensation Range

$150K - $200K