GDI / Document Intelligence & NLP Specialist

Advance Talent Solutions Incorporated; Boston (MA); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Flexible contracting opportunities

Competitive contractor compensation

Portfolio of high-impact projects

Job summary

ATS+Partners seeks a GDI/Document Intelligence & NLP Specialist with multi-year IDP/GDI experience, especially for government or regulated clients. You will own extraction pipelines, prompts, and the HITL loop to improve accuracy over a three-year contract.

Responsibilities include designing four workflows, building schemas, and maintaining a model registry with continuous improvements and benchmarking results. Boston-area role with on-site duties.

Qualifications

• 5+ years implementing IDP or GDI solutions in production environments.
• Ability to design confidence routing and HITL queues for QA.
• Must provide benchmark results showing 80%+ field-level extraction accuracy.
• Two or more GDI deployments for government/regulated sectors.
• 2+ years configuring Azure AI Document Intelligence for forms and invoices.
• Hands-on pre-processing and PDF normalization in production pipelines.

Responsibilities

• Design and configure AI extraction pipelines for four workflows.
• Develop and maintain prompt templates and JSON schemas.
• Configure model consensus and HITL routing logic.
• Build classification taxonomy and validate accuracy.
• Establish and execute accuracy benchmarking protocols.
• Lead prompt regression testing and maintain training data pipelines.
• Coordinate quarterly model fine-tuning and updates.
• Tune pre-processing parameters for high-accuracy outputs.
• Document schemas, prompts, configurations, and results in a registry.

Skills

AI/GDI implementation

Confidence scoring

Benchmark extraction accuracy

GDI for government/regulatory

Prompt engineering

RAG integration

Document classification

Model accuracy reporting

LangGraph/LangChain

Tools

Azure AI Document Intelligence

LangGraph

LangChain

ABBYY Vantage

Job description

Boston, United States | Posted on 05/20/2026

ATS+Partners is seeking a GDI / DocumentIntelligence & NLP Specialist who brings verifiable, multi-year experienceimplementing Intelligent Document Processing and Generative DocumentIntelligence solutions — ideally for government or regulated-industry clients —with documented extraction accuracy benchmarks from prior deployments. This role exists specifically to address the two most consequential gaps in the current proposal:

• Minimum Criterion 1 requires five or more years of experience implementing AI Automation and GDI solutions, preferably from municipal or government clients. The contractor’s own professional history must provide the concrete, dated implementation record that satisfies this threshold.


• Minimum Criterion 2 requires a proven ability to achieve 80%+ data extraction accuracy on unstructured documents. The contractor must be able to supply documented benchmark results from prior engagements — not theoretical capability claims — that an evaluator can verify.

The contractor will serve as the project’s extraction engine expert, responsible for the design, configuration, and continuous improvement of all AI document extraction pipelines. They will own prompt engineering for all four target workflows, configure the model ensemble’s consensus logic, build the field-level confidence scoring framework, and manage the human-in-the-loop feedback loop that drives continuous accuracy improvement throughout the three-year contract term.

PRIMARY RESPONSIBILITIES

• Design and configure AI extraction pipelines for all four target workflows: Invoice Processing, Vehicle Insurance Certificate Reconciliation, Health Insurance Reconciliation, and Audit Preparation.


• Develop and maintain custom prompt templates for GPT-4o and Claude AI, including field extraction schemas in JSON format, field-level instructions with positive and negative examples, chain-of-thought validation prompts, and conditional extraction rules.


• Configure the LangGraph consensus orchestration layer: define how discrepancies between the two model outputs are resolved, what confidence thresholds trigger automatic pass-through vs. HITL routing, and how reviewer corrections are captured in graph state for retraining.


• Build and manage the document classification pipeline: design the taxonomy for audit document categorization, train or configure the classifier against City document samples, and validate classification accuracy.


• Establish and execute the accuracy benchmarking protocol: define hold-out test sets for each workflow, run pre-pilot benchmarks, pilot accuracy benchmarks, and quarterly production accuracy audits.


• Lead prompt regression testing: maintain a library of annotated sample documents that are re-run against every prompt update and model version change to detect accuracy regressions before they reach production.


• Manage the continuous learning loop: export reviewer corrections from the HITL queue, curate training data, coordinate model fine-tuning or prompt updates on a quarterly basis.


• Configure pre-processing pipeline parameters: image quality thresholds, deskewing settings, multi-page document segmentation rules, and PDF/A normalization parameters for each document type.


• Provide domain-specific extraction expertise for ACORD insurance certificates, government invoices, AP aging schedules, GL trial balances, and health insurance enrollment forms.


• Document all extraction schemas, prompt versions, confidence threshold configurations, and model accuracy results in a version-controlled Model Registry maintained throughout the contract.

Requirements

• AI/GDI implementation experience: 5+ years implementing Intelligent Document Processing or Generative Document Intelligence solutions in production environments.


• Confidence scoring and HITL design: experience building tiered confidence routing logic connecting AI extraction outputs to human review queues.


• Documented extraction accuracy benchmarks: must be able to provide benchmark results (with methodology) from at least two prior IDP deployments showing 80%+ field-level extraction accuracy on unstructured documents.


• Government or regulated-industry IDP: at least two prior GDI/IDP implementations for government agencies, financial institutions, insurance carriers, or healthcare organizations.


• Azure AI Document Intelligence (Form Recogniser): 2+ years hands‑on configuration of pre‑built and custom models for invoice, form, and certificate extraction.


• Pre‑processing pipeline: hands‑on experience with PDF normalization, image quality scoring, deskewing, and format conversion as part of a production IDP pipeline.


• LLM prompt engineering: 2+ years designing structured extraction prompts for GPT-4o, Claude, or equivalent models, including JSON schema output, chain‑of‑thought prompting, and regression testing.


• RAG integration: experience connecting LLM extraction pipelines to vector search (Azure AI Search, Pinecone, or equivalent) for cross‑reference validation.


• Document classification: experience training or configuring document classifiers for multi‑category taxonomies in financial or government document environments.


• Model accuracy reporting: ability to produce evaluator‑grade benchmark reports with field‑level precision, recall, and F1 metrics.

PREFERRED QUALIFICATIONS

• Massachusetts municipal or state government IDP experience: prior deployment of a document intelligence solution for a Massachusetts city, town, or state agency (highest priority preference).


• LangGraph or LangChain: hands‑on experience building stateful multi‑agent extraction workflows with checkpointing and HITL interrupt/resume patterns.


• Insurance document expertise: specific experience extracting from ACORD certificates of insurance, health insurance enrollment files, or explanation‑of‑benefits documents.


• Ensemble architecture: experience building multi‑model consensus extraction systems with model‑specific confidence weighting.


• Invoice and AP document expertise: experience with multi‑vendor invoice extraction including edge cases (handwritten amounts, multi‑page invoices, non‑standard layouts).


• Audit document expertise: experience with trial balance extraction, GL account mapping, and financial work paper generation from source documents.


• HIPAA‑compliant AI pipelines: prior implementation of GDI solutions in HIPAA‑governed environments, including PHI tokenization and BAA‑covered model usage.


• Fine‑tuning and continuous learning: experience running RLHF‑style feedback loops or few‑shot fine‑tuning on domain‑specific document corpora.


• ABBYY Vantage: experience configuring ABBYY for degraded scan processing alongside primary Azure AI Document Intelligence pipeline.


• Python: proficiency for custom extraction logic, pre‑processing scripts, and benchmarking tooling.

Company Benefits for Contractors

• Flexible, project‑based consulting opportunities with the ability to work across diverse public, private, and nonprofit sector IT initiatives.


• Exposure to high‑impact digital transformation, infrastructure modernization, cybersecurity, cloud, and AI‑enabled projects that strengthen your portfolio and technical expertise.


• Collaborative partnership model that values consultant input, innovation, and professional autonomy while working alongside experienced client and project leadership teams.


• Competitive contractor compensation with opportunities for repeat engagement, long‑term client relationships, and expansion into strategic advisory or technical leadership roles.