Senior DevOps Engineer: AI/ML Data Pipelines & Infra

Authority Partners; United States; Remote; USD 140,000 - 190,000; Full time

Benefits offered by this job

Cutting-edge technologies

Top professionals to collaborate with

Great culture and environment

Collaborative learning environment

Professional training

Job summary

Authority Partners is seeking a Senior DevOps Engineer to design, develop, and maintain large-scale distributed systems. You will lead CI/CD pipelines and deployment automation for data, ML, and GenAI workloads on AWS, ensuring secure, auditable, and scalable delivery.

The role blends hands-on engineering with collaboration across teams to enable data scientists and ML engineers to focus on modeling and analytics.

Qualifications

• 5+ years in DevOps, SRE or platform engineering with 2+ years supporting ML/data/AI workloads
• Proven ability to lead technically: design a solution, propose it, and drive it to completion with other teams
• Strong hands-on AWS, including SageMaker, S3 and IAM; exposure to Amazon Bedrock
• Terraform at production scale
• CI/CD with GitHub Actions / GitHub Enterprise and GitOps with ArgoCD
• Docker and Kubernetes (EKS); exposure to a service mesh (Gloo Mesh or Istio)
• Experience building governed pipelines with automated compliance gates and audit trails
• Working knowledge of data and AI tooling such as Snowflake, Airflow and MLflow
• Daily, proficient use of AI-assisted engineering tools
• Python scripting; observability tooling such as CloudWatch, Prometheus or Grafana
• Strong documentation and knowledge-transfer habits
• Fluent English and confidence working directly with client stakeholders

Responsibilities

• Build, automate and own the CI/CD and deployment paths for data/ML/GenAI on AWS
• Create reusable, versioned pipeline templates with security/compliance by default
• Automate required gates and maintain auditable deployment paths
• Provide self-service tooling with fast feedback and clear error messages
• Collaborate with Infrastructure Platform Engineering for IaC pipelines (Terraform, Kubernetes, EKS)
• Automate model serving, versioning and rollback; monitor model performance
• Support Snowflake and Airflow workloads with artifacts in JFrog and GitOps via ArgoCD
• Enforce access control, audit logs and environment isolation; manage secrets (Secrets Manager/Vault)
• Operate and improve runbooks and daily DevOps tasks
• Use AI-assisted tooling daily to shape DevOps practices
• Document and hand over everything to enable ongoing operations

Skills

AWS

SageMaker

S3

IAM

Terraform

CI/CD

GitHub Actions

GitOps

Docker

Kubernetes (EKS)

Gloo Mesh

Istio

ArgoCD

Python

CloudWatch

Prometheus

Grafana

Documentation

Education

Bachelor's degree in Computer Science, Software Engineering or related field

Tools

Terraform

Kubernetes (EKS)

ArgoCD

SageMaker

Bedrock

Gloo Mesh

Istio

JFrog

Vault

SailPoint

Job description

Authority Partners is seeking a Senior DevOps Engineer to design, develop, and maintain large-scale distributed systems. You will lead CI/CD pipelines and deployment automation for data, ML, and GenAI workloads on AWS, ensuring secure, auditable, and scalable delivery.

The role blends hands-on engineering with collaboration across teams to enable data scientists and ML engineers to focus on modeling and analytics.