Senior DevOps Engineer - AI Infra & Scale, Stock Options

Hi Marley; Boston (MA); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Open vacation policy

Matching 401k program

Medical, dental, vision, disability, &

Life insurance

Job summary

Hi Marley is seeking a Sr. DevOps Engineer II to build and scale infrastructure powering core platform and AI services. You will drive cloud design on AWS, implement IaC with Terraform, and ensure reliability, security, and cost efficiency across multi-environment deployments.

You’ll lead cross-team initiatives, mentor engineers, and shape infrastructure standards in a fast-paced, regulated insurance workflows setting. Strong AI/ML infra experience and data warehousing expertise are valued.

Qualifications

• Bachelor's degree or equivalent experience in a technical field.
• 6+ years of DevOps/SRE/Platform Engineering experience.
• 2+ years building or operating AI/ML infrastructure (model serving, inference, LLM orchestration).
• Experience with AWS cloud services and regulated environments.

Responsibilities

• Design and operate cloud infrastructure on AWS for core SaaS and AI services.
• Build and maintain AI/ML infrastructure and monitoring for agentic services.
• Establish IaC standards using Terraform and enforce environment parity.
• Implement observability with SLOs, error budgets, and regression detection.
• Automate deployments with drift detection, rollback procedures, and CI/CD support.
• Support data pipelines, warehousing (Redshift), and analytics tooling.
• Implement security/compliance controls for AI workloads in regulated environments.
• Lead architecture reviews and mentor engineers on infra and ops best practices.

Skills

Terraform

AWS cloud services

Observability

AI/ML infra

Programming (Python/Go/TypeScript)

Container orchestration (ECS/EKS)

Compliance in regulated environments

Data pipelines & warehousing

Security & config management

Education

Bachelor's degree in Computer Science, Engineering, or equivalent

Tools

Terraform

AWS

Datadog

CloudWatch

Airflow

dbt

Dagster

SageMaker

Redshift

Job description

Hi Marley is seeking a Sr. DevOps Engineer II to build and scale infrastructure powering core platform and AI services. You will drive cloud design on AWS, implement IaC with Terraform, and ensure reliability, security, and cost efficiency across multi-environment deployments.

You’ll lead cross-team initiatives, mentor engineers, and shape infrastructure standards in a fast-paced, regulated insurance workflows setting. Strong AI/ML infra experience and data warehousing expertise are valued.