Validation Engineer, AI & Data

RADcube - A NLogix Company; Indianapolis (IN); On-site; USD 90,000 - 120,000; Full time

Job summary

RADcube - A NLogix Company is seeking a Validation Engineer, AI & Data in Indianapolis, IN. You will validate the accuracy and reliability of AI-generated responses against ground truth and approved requirements.

Responsibilities include designing testing strategies for domain context models, building automated evaluation tests, and ensuring data quality, SQL validation, and regression testing across AI systems.

Qualifications

• Experience with data quality engineering and SQL-based validation.
• Proficient Python scripting for automated tests.
• Familiarity with AI/LLM evaluation and ground-truth testing.

Responsibilities

• Design and implement testing strategies for the Domain Context Model and related AI components.
• Create ground truth QA test sets with defined tolerances and ownership validation.
• Build automated evaluation tests for AI responses via the Context Injection toolkit.
• Evaluate AI outputs with/without domain context to establish baselines and improvements.
• Validate numeric results, SQL queries, business logic, and narrative responses.
• Identify and classify failures including hallucinations and schema issues.
• Develop repeatable evaluation scripts, scoring rubrics, and dashboards.
• Verify context repository data completeness and access control behavior.
• Document test evidence, defects, remediation results, and readiness assessments.
• Support release readiness and demonstrations with reusable evaluation docs.

Skills

Data quality

SQL

Python

Automated testing

PyTest

ETL

Data validation

AI evaluation

Ground truth testing

Regression testing

Test automation

Job description

Indianapolis, United States | Posted on 11/11/2026

Founded in 2015, RADcube is a leading technology consulting and software development firm headquartered in Carmel, Indiana. The company specializes in transforming enterprise ideas into real-world innovations by leveraging emerging technologies such as Artificial Intelligence, Blockchain, and Cloud Computing.

With nearly a decade of industry experience, RADcube serves diverse sectors, including healthcare, finance, government, and manufacturing.

Their core service portfolio includes:

• Digital Transformation and strategy consulting.


• Custom Software Development tailored to specific business needs.


• Advanced Data Analytics and AI-driven platforms.


• Cybersecurity and risk management.

Recognized for its innovation-led culture, RADcube operates RADlabs, an R&D hub focused on high-impact solutions like Responsible AI and Intelligent Automation. The firm is committed to a human-centric approach, ensuring cutting-edge technology delivers measurable business outcomes and long-term success for global clients.

The company’s commitment to innovation has earned significant industry honors:

• 2026 TechPoint Mira Awards Finalist: Named a finalist for Tech Company of the Year, recognizing high-growth pioneers that demonstrate extraordinary leadership.


• Public Sector Excellence: Awarded the Utah NASPO Cloud & Software Solutions Contract, solidifying their role as a trusted partner for large-scale government digital initiatives and more.

Job Description

Validation Engineer, AI & Data

Location: Indianapolis, IN

Summary: Validate the accuracy, reliability, completeness, and consistency of business context and AI generated responses against approved business requirements and ground truth answers.

Responsibilities

• Design and implement the testing strategy for the Domain Context Model, Business Context Repository, ontology mappings, and AI response evaluation.


• Develop representative ground truth question and answer test sets with defined expected results and tolerances, validated by data owners.


• Build and maintain automated evaluation tests for AI responses generated through the client’s Context Injection toolkit.


• Evaluate AI responses with and without domain context to establish baseline accuracy and measure improvements.


• Validate numeric answers, SQL and query results, business logic, aggregations, join relationships, and narrative responses.


• Identify and classify failures, including hallucinations, stale information, incorrect schemas, faulty joins, missing business context, and persona mismatches.


• Develop repeatable evaluation scripts, scoring rubrics, regression tests, and accuracy reporting dashboards or scorecards.


• Verify context repository data completeness, classification consistency, access control behavior, and changes introduced through automated context updates.


• Document test evidence, defects, remediation results, AI readiness assessments, and validation outcomes.


• Support release readiness, weekly demonstrations, and handover of reusable evaluation frameworks and documentation.

Requirements

Required Technical Expertise: Data quality engineering, SQL, Python, automated testing, PyTest or equivalent frameworks, ETL and data validation, AI and LLM evaluation, ground truth testing, regression testing, and test automation.