Senior AI Engineer

Sky Mavis; Chicago (IL); On-site; USD 19,000 - 38,000; Full time

Job summary

GHX is seeking a Senior AI Engineer to lead the design and deployment of an LLM-powered document understanding platform. You will focus on prompt engineering, evaluation systems, and later expansion into agent orchestration and platform architecture.

A strong software engineering background (5+ years) and hands-on cloud experience are required. The role emphasizes building rigorous evaluation pipelines, scalable pipelines, and clean architectural practices while collaborating with business

Qualifications

• 5+ years of software engineering experience (Python preferred).
• Advanced prompt engineering and LLM evaluation expertise.
• Experience with ground truth dataset design.
• Hands-on experience with LLM APIs (OpenAI, Anthropic, Azure AI).
• AI agent orchestration experience.
• Strong understanding of Clean Architecture / DDD principles.
• REST API development.
• Version control (Git), CI/CD practices, containerization.
• Experience with AWS or similar cloud platforms.

Responsibilities

• Own the end-to-end lifecycle from problem framing to deployment.
• Design multi-agent document processing pipelines and tool use patterns.
• Build ground truth datasets and evaluation pipelines with accuracy benchmarks.
• Develop production-grade APIs and backend services.
• Collaborate with stakeholders to translate requirements into architectures.

Skills

Python

Prompt engineering

LLM evaluation

APIs

AWS cloud

CI/CD

Tools

OpenAI API

Anthropic API

Azure AI

LangChain

Textract

Job description

Senior AI Engineer

Location: Hyderabad, Telangana, India

About the Role

GHX is building a cutting-edge LLM-powered document understanding platform focused on classification, structured data extraction, and intelligent orchestration at scale.

This is a high-impact AI engineering role where you will own the full lifecycle—from problem framing to production deployment. Initially, you will focus on prompt engineering and evaluation systems, building the quality foundation for AI performance. Over time, the role expands into agent orchestration, system architecture, and migration of rule-based systems to LLM-driven pipelines.

A strong foundation in software engineering (5+ years) is essential. This role demands engineering rigor across both traditional system design and AI system behavior.

Role Evolution

Now (0–6 months): Prompt Engineering & Evaluation

• Design and refine prompts for classification and data extraction
• Build ground truth datasets and evaluation pipelines
• Establish accuracy benchmarks and quality baselines

Mid-Term (6–12 months): Agent Orchestration & Pipeline Design

• Develop multi-agent document processing pipelines
• Integrate MCP-based tools and external service interfaces
• Orchestrate parallel AI workflows

Long-Term (12+ months): Platform Architecture & Ownership

• Own the end-to-end document intelligence architecture
• Lead migration from rule-based to LLM-powered systems
• Define engineering standards and best practices

Core Responsibilities

1. Prompt Engineering

• Design prompts for diverse document classification and extraction tasks
• Treat prompts as formal specifications (precise, structured, and edge-case-aware)
• Develop few-shot, chain-of-thought, and structured output templates
• Manage prompt lifecycle: versioning, testing, and rollback

2. LLM Output Evaluation

• Create and maintain ground truth datasets
• Build automated evaluation pipelines (precision, recall, field-level accuracy)
• Identify and resolve conceptually incorrect outputs despite surface correctness

3. AI Agent Orchestration

• Design multi-agent workflows for document processing
• Implement tool-use patterns and integrate MCP servers
• Optimize orchestration for scale and efficiency

4. Software Engineering

• Develop production-grade APIs and backend services
• Apply Clean Architecture / DDD principles
• Write maintainable, testable Python code
• Contribute to CI/CD, deployment, and observability systems

5. Stakeholder Collaboration

• Act as a bridge between business stakeholders and AI systems
• Translate product requirements into technical architectures
• Communicate system behavior, limitations, and quality metrics clearly

Required Skills & Experience

• 5+ years of software engineering experience (Python preferred)
• Advanced prompt engineering and LLM evaluation expertise
• Experience with ground truth dataset design
• Hands‑on experience with LLM APIs (OpenAI, Anthropic, Azure AI)
• AI agent orchestration experience
• Strong understanding of Clean Architecture / DDD principles
• REST API development
• Version control (Git), CI/CD practices, containerization
• Experience with AWS or similar cloud platforms

Nice to Have

• Document understanding / OCR tools (e.g., AWS Textract)
• Experience with AWS services (EC2, S3, SQS, Lambda, ECS)
• Familiarity with LangChain / LlamaIndex
• Background in NLP or text classification systems

GHX: It's the way you do business in healthcare

Global Healthcare Exchange (GHX) enables better patient care and billions in savings for the healthcare community by maximizing automation, efficiency and accuracy of business processes.

GHX is a healthcare business and data automation company, empowering healthcare organizations to enable better patient care and maximize industry savings using our world class cloud-based supply chain technology exchange platform, solutions, analytics and services. We bring together healthcare providers and manufacturers and distributors in North America and Europe - who rely on smart, secure healthcare-focused technology and comprehensive data to automate their business processes and make more informed decisions.

It is our passion and vision for a more operationally efficient healthcare supply chain, helping organizations reduce - not shift - the cost of doing business, paving the way to delivering patient care more effectively. Together we take more than a billion dollars out of the cost of delivering healthcare every year. GHX is privately owned, operates in the United States, Canada and Europe, and employs more than 1000 people worldwide. Our corporate headquarters is in Colorado, with additional offices in Europe.

Disclaimer

Global Healthcare Exchange, LLC and its North American subsidiaries (collectively, “GHX”) provides equal employment opportunities (EEO) to all employees and applicants for employment without regard to race, color, national origin, sex, sexual orientation, gender identity, religion, age, genetic information, disability, veteran status or any other status protected by applicable law. All qualified applicants will receive consideration for employment without regard to any status protected by applicable law. This EEO policy applies to all terms, conditions, and privileges of employment, including hiring, training and development, promotion, transfer, compensation, benefits, educational assistance, termination, layoffs, social and recreational programs, and retirement.

GHX believes that employees should be provided with a working environment which enables each employee to be productive and to work to the best of his or her ability. We do not condone or tolerate an atmosphere of intimidation or harassment based on race, color, national origin, sex, sexual orientation, gender identity, religion, age, genetic information, disability, veteran status or any other status protected by applicable law. GHX expects and requires the cooperation of all employees in maintaining a discrimination and harassment‐free atmosphere. Improper interference with the ability of GHX’s employees to perform their expected job duties is absolutely not tolerated.

Read our GHX Privacy Policy