About the Role
GHX is building an LLM‑powered document understanding platform that includes classification, structured data extraction, and intelligent orchestration at scale. This broad AI engineering role covers the entire lifecycle from problem framing through to production quality.
Role – Senior AI Engineer
In this position you will own the full lifecycle of the platform, starting with designing prompts that effectively act as specifications and building the evaluation infrastructure that verifies system performance. Over time you will expand into agent orchestration, system architecture, and migrating existing rule‑based pipelines to LLM‑based equivalents.
How the Role Evolves
- Now – Design classification and extraction prompts, build ground‑truth datasets, create evaluation pipelines, and establish the quality baseline that the team will rely on.
- 6–12 mo – Extend into multi‑agent document processing pipelines, MCP‑based tool integration, and orchestration of parallel AI workstreams.
- 12 mo+ – Own the architecture of the document intelligence layer, lead the migration from rule‑based systems, and define engineering standards for the team.
Core Responsibilities
Prompt Engineering- Design classification and extraction prompts for diverse document types.
- Write prompts that function as formal specifications—unambiguous and edge‑case‑aware.
- Build and iterate few‑shot, chain‑of‑thought, and structured output templates.
- Own the prompt library, versioning, and rollback strategy.
LLM Output Evaluation- Define and curate ground‑truth datasets for classification and extraction tasks.
- Build automated evaluation pipelines tracking precision, recall, and field‑level accuracy.
- Validate outputs against intent—catch what is technically correct but conceptually wrong.
AI Agent Orchestration- Design multi‑agent pipelines for document processing workflows.
- Integrate MCP servers and tool‑use patterns for external service access.
Software Engineering- Build production‑grade APIs and services around LLM capabilities.
- Apply Clean Architecture or equivalent—design for testability and maintainability.
- Write well‑structured Python; own technical debt decisions conscientiously.
- Contribute to CI/CD, observability, and deployment pipelines.
Stakeholder Interface- Serve as technical contact between business teams and the AI engineering layer.
- Communicate system constraints in product language; translate product needs into system boundaries.
- Surface quality metrics and model behaviour to non‑technical stakeholders.
Required Skills & Experience
- Advanced prompt engineering and LLM evaluation frameworks.
- Ground‑truth dataset design.
- Experience with LLM APIs—OpenAI, Anthropic, Azure AI.
- 8+ years overall software engineering experience, preferably in Python & AWS.
- AI agent orchestration.
- Clean Architecture / DDD.
- REST API design.
- Git, CI/CD, containerisation.
Nice to Have
- Document understanding/OCR tooling like Textract.
- Experience with AWS services (EC2, SQS, S3, Lambda functions, ECS).
- LangChain / LlamaIndex.
- NLP / text classification.
What Good Looks Like
- Prompt as specification—precise, contract‑like, with edge cases considered upfront.
- Verification instinct—reads AI output critically and catches subtle errors before data quality incidents.
- Evaluation‑first mindset—does not trust a prompt in production without a test suite; builds measurement infrastructure from the start.
- Architectural thinking—understands how systems should be structured before implementation.
- Pattern fluency—knows Clean Architecture, DDD, or equivalent at the reasoning level, not just syntax.
- Communication range—can speak to both non‑technical ops managers and distributed system engineers with equal precision.
Equal Employment Opportunity
Global Healthcare Exchange, LLC and its North American subsidiaries (collectively, “GHX”) provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, national origin, sex, sexual orientation, gender identity, religion, age, genetic information, disability, veteran status or any other status protected by applicable law. All qualified applicants will receive consideration for employment without regard to any status protected by applicable law. This EEO policy applies to all terms, conditions, and privileges of employment, including hiring, training and development, promotion, transfer, compensation, benefits, educational assistance, termination, layoffs, social and recreational programs, and retirement. GHX believes that employees should be provided with a working environment which enables each employee to be productive and to work to the best of his or her ability. We do not condone or tolerate an atmosphere of intimidation or harassment based on race, color, national origin, sex, sexual orientation, gender identity, religion, age, genetic information, disability, veteran status or any other status protected by applicable law. GHX expects and requires the cooperation of all employees in maintaining a discrimination and harassment‑free atmosphere. Improper interference with the ability of GHX’s employees to perform their expected job duties is absolutely not tolerated.
Read our GHX Privacy Policy.