DevOps Engineer - IBM Watsonx Governance

Key Prediction; Austin (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

Key Prediction in Austin, TX leads the way in enterprise AI platform deployments. We are seeking an experienced DevOps Engineer to implement, configure, and support IBM watsonx Orchestrate and governance environments.

You will design CI/CD pipelines, automate infrastructure with IaC, and ensure secure, governed AI solutions across the lifecycle. Collaboration with AI engineers, security, and governance teams is essential to deliver reliable enterprise AI deployments.

Qualifications

• Hands‑on experience implementing IBM watsonx Orchestrate environments.
• Experience with IBM watsonx.governance capabilities.
• Strong CI/CD automation and environment management.
• Experience with enterprise AI platforms in regulated settings.
• Healthcare industry exposure is a plus.

Responsibilities

• Implement, configure, and support IBM watsonx Orchestrate environments.
• Support IBM watsonx.governance capabilities for AI governance.
• Deploy and integrate enterprise AI applications within watsonx.
• Design and maintain CI/CD pipelines for deployments.
• Automate infrastructure with IaC and scripting.
• Ensure security controls and access management.
• Maintain platform observability, monitoring, and runbooks.
• Collaborate with AI engineers, security, and governance teams.
• Document deployment procedures and environment standards.
• Assist with platform upgrades and release management.

Skills

IBM watsonx Orchestrate

IBM watsonx governance

CI/CD pipelines

Python scripting

Bash/PowerShell

Git / SCM

Cloud infrastructure

Security best practices

API integrations

Terraform

Docker

Kubernetes

Azure DevOps / Jenkins / GitLab CI

Tools

Terraform

Docker

Kubernetes

GitHub Actions

Jenkins

GitLab CI/CD

Azure DevOps

REST APIs

Job description

We are seeking an experienced DevOps Engineer with hands‑on experience implementing, configuring, and supporting IBM watsonx environments, specifically IBM watsonx Orchestrate and IBM watsonx.governance.

The ideal candidate will have a strong background in DevOps engineering, cloud infrastructure, CI/CD automation, platform deployment, security, and operational governance. This role will be responsible for supporting the implementation and operation of enterprise AI environments, ensuring reliable deployments, secure integrations, operational consistency, and governance throughout the AI solution lifecycle.

Experience working with enterprise AI platforms, agentic AI solutions, and regulated environments is highly valued. Healthcare industry experience is a plus.

Key Responsibilities

• Implement, configure, and support IBM watsonx Orchestrate environments, including deployment, integrations, configuration, and operational support.
• Implement and support IBM watsonx.governance capabilities to enable AI governance, risk management, lifecycle oversight, and compliance processes.
• Support the deployment, configuration, and integration of enterprise AI applications, AI agents, and associated services within IBM watsonx environments.
• Design, implement, and maintain CI/CD pipelines to automate deployment, testing, release management, and environment promotion.
• Automate infrastructure provisioning, environment configuration, and operational processes using Infrastructure as Code and scripting tools.
• Support integrations between IBM watsonx services, enterprise applications, APIs, identity providers, and other platform components.
• Implement and maintain security controls, access management, secrets management, and environment configuration standards.
• Support AI governance workflows, model and AI asset lifecycle management, risk assessment processes, and governance‑related monitoring.
• Configure and maintain monitoring, logging, alerting, and operational observability for platform components and integrations.
• Troubleshoot deployment failures, integration issues, configuration problems, and platform‑related incidents.
• Collaborate with AI Engineers, solution architects, security teams, and platform administrators to deliver reliable enterprise AI solutions.
• Maintain technical documentation, deployment procedures, operational runbooks, and environment management standards.
• Support platform upgrades, release management, environment maintenance, and continuous improvement initiatives.

Required Qualifications

• Proven experience as a DevOps Engineer, Cloud Engineer, Platform Engineer, or in a similar technical role.
• Hands‑on experience implementing and supporting IBM watsonx Orchestrate environments.
• Hands‑on experience implementing and supporting IBM watsonx.governance environments or governance capabilities.
• Experience deploying, configuring, integrating, or administering enterprise AI platforms.
• Strong understanding of CI/CD pipelines, automated deployments, environment management, and release processes.
• Experience with scripting and automation using Python, Bash, PowerShell, or equivalent tools.
• Experience with Git and source control management.
• Knowledge of cloud infrastructure, networking, identity and access management, and security best practices.
• Experience integrating enterprise platforms through APIs, connectors, and authentication mechanisms.
• Ability to troubleshoot platform configuration, deployment, integration, and operational issues.
• Strong documentation, problem‑solving, and cross‑functional collaboration skills.

Preferred Qualifications

• Experience with IBM Cloud and other IBM enterprise technologies.
• Familiarity with IBM watsonx.ai and the deployment and integration of AI/ML applications.
• Experience supporting AI agents and agent orchestration solutions, including integrations with LangGraph or similar frameworks.
• Knowledge of Infrastructure as Code tools such as Terraform.
• Experience with Docker, Kubernetes, GitHub Actions, Jenkins, GitLab CI/CD, or Azure DevOps.
• Familiarity with AI governance, model lifecycle management, AI risk management, explainability, monitoring, and regulatory compliance.
• Understanding of enterprise security controls, data privacy, auditability, and responsible AI practices.
• Previous experience in the Healthcare industry, including healthcare providers, hospitals, health insurance, or healthcare technology.
• Familiarity with HIPAA and security requirements for sensitive healthcare information.

Core Competencies

• Strong technical troubleshooting and analytical skills.
• Ability to implement and maintain secure, reliable, and governed AI platforms.
• Attention to detail in configuration, deployment, documentation, and operational controls.
• Strong collaboration skills across DevOps, AI engineering, architecture, security, and governance teams.
• Proactive approach to automation, platform reliability, and continuous improvement.

Recruitment Keywords

DevOps Engineer, IBM watsonx, IBM watsonx Orchestrate, IBM watsonx.governance, IBM Cloud, AI Platform Engineer, AI Governance, Enterprise AI, Platform Implementation, CI/CD, Infrastructure Automation, Python, REST APIs, Cloud Infrastructure, Identity and Access Management, AI Lifecycle Management, Responsible AI, Healthcare Technology, HIPAA.