DevOps Engineer

Remote; San Francisco (CA); Remote; USD 150,000 - 185,000; Full time

Benefits offered by this job

WFH monthly stipend

Healthcare benefits

401(k) plan

Unlimited PTO

Parental leave

Job summary

Arize AI, a leading AI observability platform, is hiring for a remote-first On-Prem Engineering role. You will maintain and scale distributed services, work directly with customers to tailor infrastructure, and improve release pipelines across SaaS and on-prem deployments.

Ideal candidates have 3+ years in DevOps/Cloud, strong Kubernetes skills, and experience with AWS, GCP, and Azure. The role offers a remote-first environment with optional NYC/SF offices and a competitive compensation package.

Qualifications

• 3+ years of experience in DevOps, Cloud, or infrastructure roles.
• Excellent communication skills and ability to work directly with customers to understand infrastructure needs.
• Experience and fluency in Kubernetes and multi-cloud environments.

Responsibilities

• Work hands-on with the infrastructure that supports distributed, scalable services in SaaS and on-prem offerings.
• Gather requirements from customers and adapt manifests and software for new environments.
• Use and augment monitoring tools to observe platform health, performance and reliability.
• Interact with product team to test features and package on-prem releases.
• Automate and optimize release pipelines to reduce friction.
• Stay curious about emerging technologies to solve challenges.

Skills

DevOps Engineer

Cloud Engineer

Infrastructure Engineer

Communication skills

Tools

Kubernetes

AWS

GCP

Azure

Job description

About Arize

AI is rapidly transforming the world. As generative AI reshapes industries, teams need powerful ways to monitor, troubleshoot, and optimize their AI systems. That’s where we come in. Arize AI is the leading AI & Agent Engineering observability and evaluation platform, empowering AI engineers to ship high-performing, reliable agents and applications. From first prototype to production scale, Arize AX unifies build, test, and run in a single workspace—so teams can ship faster with confidence.

We’re a Series C company backed by top-tier investors,with over $135M in funding and a rapidly growing customer base of 150+ leading enterprises and Fortune 500 companies. Customers like Booking.com, Uber, Siemens, and PepsiCo leverage Arize to deliver AI that works.

The Team

Our On-Prem engineering team is responsible for the deployment of Arize in customer environments. In addition to working with customers in defining infrastructure requirements, the team designs and develops software and tooling that enables the management of these systems at large scale. The On-Prem team has grown to be expert in Kubernetes and cloud deployment on GCP, Azure, and AWS as well as dealing with networking and security aspects of on-premise deployments. The team is dynamic and relies on few talented individuals with a high degree of autonomy and initiative.

What You’ll Do

• Work hands-on with the infrastructure that supports our distributed & highly scalable services in both SaaS and on-prem offerings




• Gather requirements from customers and adapt manifests and software to support new environments




• Use and augment monitoring tools to observe platform health, ensure performance and reliability




• Interact with the product team to test new features and package new on-prem releases




• Automate and optimize the release pipeline to make it as frictionless as possible




• Exhibit continuous curiosity for emerging technology that could solve our challenges

What will set you apart:

• 3+ years of experience as a DevOps Engineer, Cloud Engineer, Infrastructure Engineer or similar




• Excellent communication skills and ability to work directly with customers to understand and address their infrastructure needs




• Experience and fluency in Kubernetes




• A self starter with an ability to thrived in a fast paced environment




• Experience working with multiple cloud providers (AWS, GCP, Azure) and understanding how to adapt cloud-native architectures for on-premises environments




• Strong troubleshooting skills

Bench Engineer Submissions: We do not accept resumes or candidate submissions for bench engineers—individuals currently employed by a staffing, consulting, or third-party organization who are being marketed for placement on client engagements. All candidates applying for consideration must be seeking direct employment with Arize and should not be presented as part of an agency or consulting firm’s available bench.

The estimated annual salary for this role is between $150,000 - $185,000, plus a competitive equity package. Actual compensation is determined based upon a variety of job related factors that may include: transferable work experience, skill sets, and qualifications. Total compensation also includes a comprehensive benefit package, including: medical, dental, vision, 401(k) plan, unlimited paid time off, generous parental leave plan, and others for mental and wellness support.

• medical


• dental


• vision


• 401(k) plan


• unlimited paid time off


• generous parental leave plan


• others for mental and wellness support

While we are a remote-first company, we have opened offices in New York City and the San Francisco Bay Area, as an option for those in those cities who wish to work in-person. For all other employees, there is a WFH monthly stipend to pay for co-working spaces.

More About Arize

Arize’s mission is to make the world’s AI work—and work for people.
Our founders came together through a shared frustration: while investments in AI are growing rapidly across every industry, organizations face a critical challenge—understanding whether AI is performing and how to improve it at scale.

Learn more about what we're doing here:

https://techcrunch.com/2025/02/20/arize-ai-hopes-it-has-first-mover-advantage-in-ai-observability/

https://arize.com/blog/arize-ai-raises-70m-series-c-to-build-the-gold-standard-for-ai-evaluation-observability/

Diversity & Inclusion @ Arize

Our company's mission is to make AI work and make AI work for the people, we hope to make an impact in bias industry-wide and that's a big motivator for people who work here. We actively hope that individuals contribute to a good culture

• Regularly have chats with industry experts, researchers, and ethicists across the ecosystem to advance the use of responsible AI




• Culturally conscious events such as LGBTQ trivia during pride month




• We have an active Lady Arizers subgroup