Principal DevOps Engineer

Hi Marley

Boston (MA)

Hybrid

USD 119,000 - 221,000

Full time

8 days ago
Application generator

A complete application in a minute — tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Equity grants
401(k) matching
Medical, dental, vision insurance
Monthly wellness stipend
Paid parental leave
Flexible vacation policy

Job summary

Hi Marley is seeking a Principal DevOps Engineer to design and operate AWS-based infrastructure powering our core SaaS platform and AI services in Boston. You will implement IaC patterns, observability, and regulatory controls to ensure reliability and compliance.

You’ll lead architecture reviews, mentor engineers, and advance developer experience while collaborating across teams in a fast-moving environment that evolves AI capabilities rapidly.

Qualifications

  • 6+ years of DevOps/SRE/Platform Engineering experience
  • 2+ years building or operating AI/ML infra
  • Bachelor’s degree in CS/engineering or equivalent
  • Built and operated infra for SaaS and AI/ML workloads
  • Leadership in cross-team infrastructure discussions
  • Strong AWS experience (ECS, Lambda, SageMaker, Bedrock, S3, DynamoDB, Redshift)
  • Terraform IaC with multi-environment configuration
  • Understanding data pipelines and warehousing for analytics
  • Observability focus: SLOs, error budgets, drift detection
  • Compliance: audit trails, access governance, change management

Responsibilities

  • Design and operate cloud infrastructure on AWS for core platform and AI services
  • Build and maintain AI/ML infrastructure and monitoring
  • Enforce infrastructure-as-code standards with Terraform
  • Implement data integrity, SLOs, and automated regression for platform and AI services
  • Develop deployment automation and rollback procedures
  • Support data pipelines, warehousing, and analytics tooling
  • Lead architecture reviews and mentor engineers
  • Improve developer experience across CI/CD and testing environments
  • Drive environment parity and automated drift remediation
  • Ensure security controls for regulated workloads

Skills

AWS cloud
Terraform
Observability
Python/Go
SRE/DevOps
Leadership

Education

Bachelor’s degree in CS or engineering

Tools

ECS
EKS
Datadog
CloudWatch
Redshift
Airflow/dbt/Dagster

Job description

Insurance touches people during some of the most challenging moments in their lives.Hi Marleyis on a mission to transform how the P&C industry communicates, making those moments faster, easier, and more empathetic for carriers and the customers they serve. We build AI-powered software that keeps everyone in theclaimsconversation informed and connected. If you believe insurance can combine operational excellence and automation with a human touch,we’dlove to meet you.

We are looking for a Principal DevOps Engineer to help us build and scale the infrastructure that powers both our core platform and our rapidly growing agentic AI services. You will be at the intersection of cloud infrastructure, AI operations, and platform engineering — building the foundation that enables Hi Marley tooperatereliably at enterprise scale while deploying autonomous AI agents in regulated insurance workflows.You’llalso be expected to raise the bar for the teams around you — setting infrastructure standards, driving technical decisions in ambiguous situations, and helping less experienced engineers grow their operational instincts. Teamwork and shared enthusiasm are a core part of our culture, which is why this role involves joining us in the Boston office for 3 days each week.

What You’ll Do:
  • Design andoperatecloud infrastructure on AWS that supports both our core SaaS platform and our agentic AI services, ensuring reliability, scalability, and cost efficiency
  • Build andmaintainAI/ML infrastructureand monitoring for LLM-powered agentic services
  • Establish and enforce infrastructure-as-code standards using Terraform, defining the patterns other engineers follow for environment parity, drift detection, and automated compliance validation
  • Implement observability beyond availability — data integrity monitoring, SLO frameworks with error budgets, and automated regression detection for both platform and AI services
  • Build deployment automation including pre-deployment verification, migration script validation, and codified rollback procedures toeliminatehuman-memory dependencies
  • Support big data infrastructure: data pipelines, warehousing (Redshift), and analytics tooling that enables reporting, BI, and AI training workflows
  • Implement security and compliance controls for AI workloadsoperatingin regulated carrier environments — including audit logging, access governance, and configuration management
  • Drive environment parity across all infrastructurewith automated drift detection and remediation
  • Improvedisaster recovery capabilities: documented and rehearsed DR procedures, defined RTO/RPO by service tier, and tested recovery runbooks
  • Lead architecture reviews for new services, integrations, and AI agent deployments — partnering with engineering, product, and security to ensure infrastructure decisions are sound before they ship
  • Innovate on developer experience: reduce friction in testing environments, CI/CD pipelines, and local development workflows
  • Act as a technical anchor for infrastructure decisions across teams — providing clarity when requirements are ambiguous and helping the organization converge on consistent, scalable approaches
What We’re Looking For:
  • 6-+ years of DevOps/SRE/Platform Engineering experience
  • 2+ years of experience building or operating AI/ML infrastructure (model serving, inference, LLM orchestration, or agentic systems)
  • Bachelor’s degree in Computer Science, Engineering, or equivalent experience
  • You have built and operated infrastructure fortraditional andAIorML workloads at a SaaS company
  • You naturally step up to lead technical conversations, and people across teams seek you out when infrastructure decisions get complicated
  • You have deep experience with AWS cloud services (ECS, Lambda, SageMaker, Bedrock, S3, DynamoDB, Redshift, or equivalent)
  • You have strong infrastructure-as-code skills with Terraform and understand how to manage state, modules, and multi-environment configurations
  • You understand data infrastructure: pipelines, warehousing, ETL/ELT, and how to support analytics at scale
  • You think about observability as more than dashboards — you care about data integrity, SLOs, error budgets, and catching silent failures
  • You have experience with compliance-sensitive environments and understand why audit trails, access governance, and change management matter
  • You are comfortable operating in a fast-moving environment where AI capabilities are evolvingrapidlyand infrastructure decisions have regulatory implications
  • You communicate well with both engineering and non-technical stakeholders
  • Track recordof leading cross-team technical initiatives and mentoring engineers on infrastructure and operational best practices
  • Strongproficiencyin at least one programming language (Python, Go, TypeScript, or similar)
  • Experiencewith:
    • Container orchestration (ECS, EKS)
    • Monitoring and observability platforms (Datadog, CloudWatch)
    • Data infrastructure (Redshift, or similar data warehousing; Airflow,dbt,Dagsteror similar pipeline tools) is a strong plus
  • Experience in regulated industries (insurance, financial services, healthcare) is a strong plus
  • A genuine curiosity about AI and emerging technologies, paired with the judgment to apply them thoughtfully and responsibly
Compensation, Benefits & Perks:

At Hi Marley, we are committed to fair and transparent pay practices. The annual base salary for this role is expected to fall within the range of [$119,000–$221,000], depending on experience, skills, qualifications, and location. Offers are determinedbased on these factors as well as internal peer equity.It’smost common for new hires to start near the midpoint of the range, allowing room for growth as employees develop in their role.

In addition to base pay, we offer a comprehensive total rewards package that supports both your wellbeing and professional growth, including:

  • Equity grants for all employees
  • A 4% matching 401(k) program
  • Medical, dental, vision, disability, and life insurance coverage for employees working 30+ hours per week
  • Monthly wellness stipend
  • Paid parental leave
  • A flexible vacation policy - we all work hard and take time when we need it
Who We Are:

At Hi Marley, our culture is built on three core values that every employee embodies:

  • Max Courage – We encourage our team, our customers, and their customers to dream big, try new ideas, and maximize impact by measuring risk.
  • Be Humble – We lead with appreciation and promote a culture of humility, compassion, and openness to learn from anyone, anywhere.
  • Ubuntu (“I am because we are”)– We believe true success is much bigger than any single individual or company. By aligning our individual aims behind a shared purpose, we can achieve our fullest potential — together.
Life at Hi Marley:

Life at Hi Marley is shaped by collaboration, learning, and genuine connection. We’re proud to foster an environment where people can do their best work, feel supported, and grow alongside a team that celebrates both individuality and shared purpose.

  • A fun, lively startup culture that embraces creativity and innovation
  • Core values-based leadership that guides our decision-making and daily interactions
  • A culture of engagement, diversity, inclusion, and belonging — everyone’s voice matters
  • Flexible, hybrid work environment that values balance and trust
  • Ample opportunities to learn, take on new challenges, and make an impact in a fast-growing organization
  • Meaningful work that directly support… etc

Hi Marley is proud to be an equal employment opportunity employer. We celebrate diversity and do not discriminate based on gender, sexual orientation, gender identity, religion, race, veteran status, disability status, or any other characteristic protected by applicable law. We are committed to building an inclusive work environment representing a variety of backgrounds, perspectives, and skills, where all employees are encouraged to be their authentic selves.

Hi Marley participates in E-Verify and will provide the federal government with your Form I-9 information to confirm that you are authorized to work in the U.S. For more information, please review the documents under “E-Verify Poster” here: https://e-verify.uscis.gov/web/OnlineResources.aspx

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal AI Platform Engineer
Principal AI Platform Engineer

Hi Marley • Boston (MA)

Hybrid
USD 152,000 - 283,000
Equity grants for all employees
401(k) matching
Comprehensive insurance coverage
+1
Principal Builder - AI Infrastructure
Principal Builder - AI Infrastructure

Hi Marley • Boston (MA)

Hybrid
USD 152,000 - 283,000
Equity grants
401(k) matching
Health insurance
+3
Principal Builder - AI UX
Principal Builder - AI UX

Hi Marley • Boston (MA)

Hybrid
USD 152,000 - 283,000
Equity grants for all employees
4% matching 401(k) program
Medical, dental, vision, disability, &
+4
Principal Industry Strategist (Property & Casualty)
Principal Industry Strategist (Property & Casualty)

Hi Marley • Boston (MA)

Hybrid
USD 142,000 - 263,000
Equity grants for all employees
4% matching 401(k) program
Medical, dental, vision, disability, &
+4
Sr. Sales Operations Manager
Sr. Sales Operations Manager

Hi Marley Inc • Boston (MA)

Hybrid
USD 91,000 - 169,000
Equity grants
401(k) matching
Medical, dental, vision insurance
+3
Sr. Sales Operations Manager
Sr. Sales Operations Manager

Hi Marley • Boston (MA)

On-site
USD 91,000 - 169,000
Equity grants for all employees
4% matching 401(k)
Medical, dental, vision, disability, &
+4
Director, Customer Experience & Scaled Success
Director, Customer Experience & Scaled Success

Hi Marley • Boston (MA)

On-site
USD 115,500 - 214,500
Equity grants
401(k) matching program
Medical, dental, vision insurance
+2
Sr. Content Manager, Learning & Enablement (Customer)
Sr. Content Manager, Learning & Enablement (Customer)

Hi Marley • Boston (MA)

On-site
USD 71,000 - 132,000
Equity grants
401(k) matching
Medical, dental, vision insurance
+3
Sr. Design Technologist / Design Engineer
Sr. Design Technologist / Design Engineer

SupportFinity™ • Boston (MA)

Hybrid
USD 111,000 - 207,000
Equity grants for all employees
4% matching 401(k) program
Medical, dental, vision, disability, and life insurance
+3
Senior Client Executive
Senior Client Executive

Hi Marley • Boston (MA)

On-site
USD 80,000 - 120,000
Full benefits package
Open vacation policy
Competitive salary
+6