Principal Software Engineer, Agentic AI & Orchestration

ChatGPT Jobs; Raleigh (NC); Hybrid; USD 148,540 - 245,050; Full time

Benefits offered by this job

Comprehensive medical, dental, and vision coverage

Retirement 401(k) with employer match

Paid parental leave plans

Job summary

A leading open source software provider is looking for a Principal Software Engineer to join their team in Raleigh, NC. This role will focus on designing and implementing innovative Agentic AI features. The ideal candidate should have at least 7 years of experience, a background in computer science, and expertise in AI integration and distributed systems. The company offers competitive salaries and comprehensive benefits, including health coverage and retirement plans.

Qualifications

• 7+ years of relevant software engineering experience.
• Proven experience building agents and tooling frameworks.
• Expert-level proficiency in Python or Go.

Responsibilities

• Lead the implementation of scalable, distributed computing solutions.
• Develop technical blueprints and multi-product demos.
• Contribute to and influence upstream AI/ML communities.

Skills

Architectural Leadership

MAS Design

Interoperability Standards

Strategic Collaboration

Innovation

Engineering Excellence

Education

Bachelor's degree in Computer Science or related technical field

Tools

Python

Go

OpenShift

Kubernetes

Job description

Job Description

Principal Software Engineer, Agentic AI & Orchestration

Red Hat - Raleigh, NC

On-site, Remote

Full-time

Salary: $148.54K - $245.05K/yr

Benefits: Medical, Dental, Vision, Retirement, PTO

Posted 5 hours ago

About The Job

Red Hat is seeking a Principal Software Engineer to join our team. In this role, you will collaborate with a diverse, highly motivated group of engineers to design and implement Agentic AI features and solutions and integrate partner solutions. You will also work closely with product management, other engineering teams at Red Hat, as well as Red Hat partners and lighthouse customers.

Are you ready to develop innovative solutions that combine open source, hybrid cloud, and AI?

What You Will Do

• Architectural Leadership: Lead the implementation of scalable, distributed computing solutions designed to serve Agentic AI and ensure seamless integration with the Red Hat product portfolio.
• MAS Design: Define and implement Multi-Agent System (MAS) architectures, including orchestration layers, state machines, tool registries, and resilient routing policies with safe fallbacks.
• Interoperability Standards: Hands‑on experience implementing Model Context Protocol (MCP) for standardized tool/data access and Agent‑to‑Agent (A2A) or ACP protocols for cross‑platform agent communication and task delegation.
• Upstream Influence: Contribute to and influence upstream AI/ML communities to steer the evolution of open standards for agentic workflows.
• Strategic Collaboration: Partner with AI/ML vendors and internal teams to refine AI strategies, addressing specific use cases that drive value through Red Hat's next‑generation UX.
• Reference Architectures: Develop technical blueprints and multi‑product demos that showcase the “Art of the Possible” using the Red Hat AI stack.
• Innovation: Proactively explore emerging AI technologies to identify opportunities for incorporating new capabilities into software development workflows and tooling.
• Engineering Excellence: Drive AI integration within the software development lifecycle (SDLC), sharing successful experiment use cases with stakeholders to foster broader innovation.

What You Will Bring

• 7+ years of relevant software engineering experience
• Bachelor's degree in Computer Science or a related technical field, or equivalent practical experience
• Agentic Frameworks: Proven experience building agents and tooling frameworks; deep expertise in LangGraph, PydanticAI, or similar state-management libraries.
• Core AI Engineering: Experience implementing sophisticated RAG, long-term memory systems, semantic caches, and vector databases.
• Systems Expertise: Expert-level proficiency in Python or Go, with a specific focus on building resilient, asynchronous distributed systems.
• Infrastructure: Solid experience with containers and orchestration via OpenShift or Kubernetes.
• Inference Optimization: Familiarity with model parallelization, quantization, and memory optimization (e.g., vLLM, DeepSpeed, OpenVino).
• AI/MLOps: Experience with GitOps, automation pipelines, and managing the AI/ML lifecycle in production environments.
• Evaluation & Safety: Direct experience with Agent Evaluation (Eval) frameworks (measuring success rates/hallucinations) and implementing Guardrails & Governance (preventing prompt injection/infinite loops).

The Following Are Considered a Plus

• Cloud Computing experience with AWS, GCP, Azure, or IBM Cloud.
• A history of open-source contributions or active participation in the AI/ML community (GitHub, Research, or Upstream).

Red Hat is the world's leading provider of enterprise open source software solutions, using a community-powered approach to deliver high-performing Linux, cloud, container, and Kubernetes technologies.

Benefits

• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account – healthcare and dependent care
• Health Savings Account – high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

Note: These benefits are only applicable to full time, permanent associates at Red Hat located in the United States.