Lead Consultant, AI Delivery Assessment

InRhythm; Texas; Remote; USD 140,000 - 200,000; Full time

Job summary

InRhythm seeks a Lead Consultant for AI Delivery Assessment (L4) based in Dallas, TX, with mostly remote work. You will evaluate AI-driven software delivery systems across the lifecycle, tracing user stories to pull requests and designing controlled experiments.

Collaborate with client engineers, security experts, and stakeholders to translate findings into actionable recommendations. You will report to the Principal Consultant and contribute to the enterprise AI delivery assessment.

Qualifications

• 8+ years of professional software engineering experience.
• Hands-on with AI coding agents and agent-based delivery pipelines.
• Proficient in Go and at least one of Java/TypeScript/Python.
• Experience with distributed systems and multi-repository environments.
• Knowledge of CI/CD, testing practices, and code review processes.
• Familiarity with DORA metrics and software delivery performance.
• Strong documentation, writing, and stakeholder communication.

Responsibilities

• Examine enterprise AI delivery architectures and governance rules.
• Trace changes from user stories through implementation and PRs.
• Evaluate how AI agents interpret context to complete tasks.
• Design and run controlled experiments to test AI behavior and reliability.
• Conduct repeatable tests and document outcomes.
• Collect and interpret software delivery metrics for performance.
• Compare AI-assisted vs traditional delivery to identify improvements and risks.
• Evaluate workflows across repositories and integrated systems.
• Interview engineers and stakeholders to capture real-world practices.
• Observe bottlenecks and opportunities for improvement.
• Document findings in a transparent, reproducible manner.
• Collaborate to translate findings into client recommendations.

Skills

Go

Java/TypeScript/Python

Distributed systems

CI/CD

DORA metrics

Technical writing

Communication

Job description

At InRhythm, our mission is to make a meaningful impact on the digital economy. We partner with Fortune 50 enterprises, high-growth startups, and innovative organizations to bring next-generation digital products and platforms to market.

Having helped hundreds of engineering teams launch mission-critical products and platforms that have generated billions of dollars in business impact, we are passionate about transforming how organizations build, deliver, and scale digital solutions.

Recognized as an Inc. 5000 Hall of Fame Fastest Growing Company, a Deloitte Fast 500 company, and a Consulting Magazine Fastest Growing Company, InRhythm continues to grow by bringing together exceptional engineers, consultants, and technology thought leaders.

We help enterprises accelerate innovation through modern engineering practices, high-velocity delivery cultures, emerging technologies, and strategic technology leadership. Our goal is to enable organizations to deliver better, faster, and with greater impact.

At InRhythm, we believe in entrepreneurship, continuous learning, collaboration, innovation, and challenging conventional thinking. We foster an environment where talented individuals can grow, share knowledge, work alongside industry thought leaders, and make a meaningful difference.

Title: Lead Consultant, AI Delivery Assessment (L4)

Location: Dallas, TX (Mostly Remote, with occasional on-site client sessions)

Employment Type: Full-time

About the Role

As enterprises increasingly adopt AI agents to perform software engineering activities, understanding whether these systems work reliably in real-world engineering environments becomes critical.

AI agents are evolving beyond code assistants. They can plan engineering changes, generate code, execute tests, review implementations, and create pull requests for human approval.

However, organizations need objective, evidence-based assessments to understand how effectively these systems operate, whether they improve engineering productivity, and whether they can scale across multiple teams without compromising software quality, security, and reliability.

As a Lead Consultant, AI Delivery Assessment, you will play a hands-on role in evaluating enterprise AI-driven software delivery systems.

You will investigate how AI agents operate across the software development lifecycle, trace real engineering changes from initial requirements through pull requests, conduct controlled technical experiments, and measure delivery performance.

Working closely with client engineering teams, platform specialists, security experts, and other stakeholders, you will translate technical observations into clear, evidence-based findings and recommendations.

You will collaborate with and report to the Principal Consultant, contributing to the overall enterprise AI Delivery Assessment.

What You Will Do

• Examine enterprise AI delivery architectures, including AI agents, orchestration workflows, execution stages, approval mechanisms, governance rules, and underlying data sources.
• Trace real engineering changes from initial user stories and requirements through implementation, testing, code review, and pull request creation.
• Evaluate how effectively AI agents receive, interpret, and utilize the context and information required to complete their assigned tasks.
• Design and execute controlled technical experiments to evaluate AI agent behavior, system reliability, consistency, and delivery effectiveness.
• Conduct repeatable tests by isolating individual variables and documenting observed outcomes.
• Collect, analyze, and interpret software delivery metrics to evaluate engineering performance.
• Compare AI-assisted and traditional software delivery approaches to identify measurable improvements, limitations, and potential risks.
• Evaluate engineering workflows across multiple repositories, services, and integrated systems.
• Interview software engineers, technical reviewers, approvers, and platform specialists to understand real-world delivery practices.
• Observe engineering workflows and identify operational bottlenecks, process gaps, and opportunities for improvement.
• Assess AI agent execution, code quality, testing effectiveness, review processes, and human intervention requirements.
• Document technical findings, test results, observations, and conclusions in a structured and evidence-based manner.
• Ensure assessment findings are reproducible, transparent, and independently verifiable.
• Collaborate with the Principal Consultant to translate technical findings into actionable recommendations for client stakeholders.

Required Qualifications

• 8+ years of professional software engineering experience.
• Hands-on experience working with AI coding agents and agent-based software delivery pipelines.
• Strong ability to read, understand, review, and evaluate code written in Go and at least one of the following: Java, TypeScript, or Python.
• Experience working with distributed systems, multiple repositories, microservices, and interconnected enterprise applications.
• Strong understanding of modern software development lifecycles, CI/CD pipelines, testing practices, and code review processes.
• Experience measuring and evaluating software delivery performance, including familiarity with DORA metrics.
• Experience investigating complex engineering workflows and identifying technical and operational bottlenecks.
• Ability to design controlled experiments, analyze results, and draw evidence-based conclusions.
• Strong technical documentation and writing skills.
• Excellent communication and collaboration skills when working with engineering teams and technical stakeholders.

Preferred Qualifications

• Experience evaluating security controls, governance mechanisms, and risk management practices for AI agents.
• Experience working in regulated industries, particularly financial services, banking, or payments.
• Previous experience in technology consulting or enterprise technical assessment engagements.
• Familiarity with AI governance, responsible AI practices, and agentic engineering architectures.
• Experience evaluating developer productivity, engineering effectiveness, and software delivery maturity.
• Knowledge of emerging AI-assisted software engineering practices and enterprise AI adoption models.

The InRhythm Consultant

At InRhythm, we hire consultants and thought leaders, not just engineers. We value individuals who combine technical depth with strategic thinking, collaboration, and a strong sense of ownership.

We look for professionals who demonstrate:

• Strategic Thinking: Connect technical findings and engineering observations to broader business outcomes.
• Client Partnership: Build trust and strong working relationships with the engineers and stakeholders whose systems and processes are being assessed.
• Adaptability: Navigate ambiguity, incomplete information, and evolving technology environments.
• Communication: Explain complex technical concepts clearly and appropriately to engineering teams and business stakeholders.
• Ownership: Take responsibility for the accuracy, transparency, and integrity of assessment findings, including documenting failures and limitations.
• Continuous Learning: Stay current with emerging AI technologies, agentic engineering practices, and modern software delivery methodologies.

Why Join InRhythm?

At InRhythm, you'll have the opportunity to work alongside exceptional engineers, consultants, and technology thought leaders on transformative enterprise initiatives.

We offer an environment that encourages professional growth, innovation, collaboration, and continuous advancement.

Our employee benefits include:

• Comprehensive healthcare plans.
• Professional development and skills training.
• Wellness reimbursements.
• Opportunities to collaborate with industry experts and participate in knowledge-sharing workshops.
• A flexible and supportive work environment.
• Employee recognition and community-building initiatives.
• Birthday dinner benefits for employees and their families.

We believe in creating a workplace where people can challenge conventional thinking, explore new ideas, advance their careers, and do meaningful work.

Join Us

If you are passionate about AI-driven software engineering, hands-on technical assessment, engineering effectiveness, and helping enterprises understand the real-world impact of AI agents,

we would love to hear from you.

Join InRhythm and help shape the future of intelligent software delivery by bringing evidence, engineering excellence, and innovation together.

Build better. Deliver faster. Make an impact. Build in rhythm.