Senior Agentic DevOps Engineer – Runtime Validation & Governance

Keysight Technologies SAles Spain SL.; Calabasas (CA); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Medical, dental and vision

401(k) Plan

Tuition Reimbursement

Flexible Time Off

Job summary

A leading technology firm in California is seeking a Senior Agentic DevOps Engineer to architect systems for validating and governing AI-generated orchestration in production. This role focuses on developing a robust pipeline for agent-generated logic, ensuring safety, traceability, and operational trust. Candidates should have a PhD or substantial experience in systems engineering, with proficiency in Python, C/C++, and CI/CD environments. Competitive benefits offered including flexible time off and health insurance.

Qualifications

• PhD or 5+ years of experience in systems engineering, runtime validation, or high-assurance deployment frameworks.
• Strong proficiency in Python and C/C++.
• Experience designing sandboxed execution environments.

Responsibilities

• Architect and implement runtime validation for autonomous agent logic.
• Build and maintain a continuous validation pipeline.
• Lead the definition of safety certification frameworks for agent-generated actions.

Skills

CI/CD systems

Python

C/C++

sandboxed execution environments

regression governance

agentic AI frameworks

Education

PhD or 5+ years of experience

Job description

Overview

Keysight is at the forefront of technology innovation, delivering breakthroughs and trusted insights in electronic design, simulation, prototyping, test, manufacturing, and optimization. Our ~15,000 employees create world‑class solutions in communications, 5G, automotive, energy, quantum, aerospace, defense, and semiconductor markets for customers in over 100 countries.

Our award‑winning culture embraces a bold vision of where technology can take us and a passion for tackling challenging problems with industry‑first solutions. We believe that when people feel a sense of belonging, they can be more creative, innovative, and thrive at all points in their careers.

About the Initiative

Keysight’s Applied AI Autonomy Initiative is developing a next‑generation agentic orchestration framework that enables AI agents to reason, adapt, and coordinate across complex engineering workflows. Built on LangGraph and reinforcement‑inspired feedback mechanisms, this framework transforms prompts and design intents into executable orchestration strategies that evolve autonomously through iterative simulation and validation loops.

Our ambition is not merely to replicate human reasoning, but to push past human limits—enabling agentic systems to explore design spaces, optimize engineering workflows, and evolve orchestration strategies at a scale and speed no human could achieve.

To make this possible, it will require robust runtime governance and regression intelligence layer—one that ensures every autonomous action is verified, reversible, traceable, and safe before it influences live engineering systems.

This role defines that layer: the bridge between autonomy and operational trust, enabling production‑scale AI‑driven orchestration with assurance and auditability.

What This Role Offers

• A foundational and highly visible role shaping how AI‑generated orchestration earns operational trust across Keysight’s engineering ecosystem.
• The mandate to define the validation, governance, and assurance standards that determine when and how autonomous agent logic may safely enter production.
• Ownership of the mission‑critical regression and verification pipeline, where agent actions, simulation feedback, and safety controls converge—enabling autonomy that is explainable, reversible, measurable, and audit‑ready.

Responsibilities

Role Overview

As the Senior Agentic DevOps Engineer, you will architect and implement the runtime validation, control, and feedback systems that govern how agent‑generated logic is tested, verified, and promoted into production. This is not classical DevOps or CI/CD— it is Agentic DevOps: embedding intelligent agents into the deployment fabric with guardrails, feedback loops, rollback capabilities, and telemetry built into every stage. Your mission is to enable a self‑aware orchestration pipeline where agents can act, learn, adapt, and be safely governed, delivering predictable and stable outcomes across dynamic, high‑assurance environments.

1. Execution Integrity Architecture

• Design sandboxed and containerized evaluation zones for testing agent‑generated logic prior to deployment.
• Build a multi‑stage release pipeline spanning sandbox → validation → gated staging → monitored execution.
• Define and enforce isolation and containment protocols to prevent propagation of unsafe or misconfigured agent actions.
• Establish runtime health scoring, confidence thresholds, and promotion gates to control when an agent’s output can advance to production.

1. Regression Intelligence & Continuous Verification

• Develop regression and validation frameworks tailored for agentic orchestrations to detect drift, instability, or emergent behaviors.
• Implement baseline comparison and differential validation systems to continuously verify agent outputs against expected outcomes.
• Construct autonomous CI/CD pipelines integrating both neural (agent‑generated) and traditional (human‑written) logic with versioning and reproducibility guarantees.
• Provide predictable replay and audit mechanisms to re‑execute orchestration cycles for debugging, validation, and compliance.

1. Observability, Governance & Rollback

• Engineer always‑on telemetry and introspection pipelines capturing every agent decision, validation result, and anomaly.
• Develop snapshot and rollback frameworks enabling rapid restoration to verified system states.
• Ensure end‑to‑end traceability of all orchestration artifacts, mapping which agent produced what output, with what data and under what conditions.
• Surface trust metrics, validation outcomes, and confidence scores through operator dashboards and governance APIs in collaboration with Dev/UI teams.

Key Responsibilities

• Lead the definition and implementation of validation, governance, and regression standards across Keysight’s agentic orchestration runtime.
• Architect and deploy a continuous validation pipeline integrating feedback loops, guardrails, telemetry, and rollback systems.
• Build self‑diagnosing runtime logic that enables agents and infrastructure to detect, contain, and recover from instability autonomously.
• Define and maintain safety certification, auditability, and reproducibility frameworks for agent‑generated actions in production.
• Collaborate with framework architects, safety engineers, ML researchers, and data intelligence teams to align validation infrastructure with orchestration and learning feedback systems.

Qualifications

Required Qualifications

• PhD or 5+ years of experience in systems engineering, runtime validation, safety‑critical infrastructure, or high‑assurance deployment frameworks.
• Proficiency with CI/CD systems (e.g., Jenkins, GitLab CI, GitHub Actions, or ArgoCD) for automation, validation, and controlled deployments.
• Proven experience designing sandboxed execution environments, controlled‑release and CI/CD pipelines, or validated deployment systems at production scale.
• Strong proficiency in Python and C/C++, with expertise in sandbox architecture, promotion control, and rollback mechanisms.
• Demonstrated ability in regression governance, continuous verification, and telemetry‑driven runtime monitoring.
• Proficiency with agentic AI frameworks (e.g., LangGraph, LangChain) and validation mechanisms for multi‑agent orchestration and reasoning stability.

Preferred Qualifications

• Experience with simulation orchestration, HPC systems, or digital‑twin environments feeding live feedback into control loops.
• Knowledge of differential validation, golden‑run comparison, confidence‑scored promotion models, and structured evaluation frameworks.
• Background in governance frameworks for machine‑generated logic or autonomous systems (e.g., AI or robotics).

Benefits

• Medical, dental and vision
• Health Savings Account
• Health Care and Dependent Care Flexible Spending Accounts
• Life, Accident, Disability insurance
• Business Travel Accident and Business Travel Health
• 401(k) Plan
• Flexible Time Off, Paid Holidays
• Paid Family Leave
• Discounts, Perks
• Tuition Reimbursement
• Adoption Assistance
• ESPP (Employee Stock Purchase Plan)
• Restricted Stock Units

Keysight is an Equal Opportunity Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other protected categories under all applicable laws.