Remote AI Platform Engineer Production-Grade LLM Pipelines

Megsoft; Northern (KY); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Megsoft is seeking an experienced software engineer to design and build production-grade AI pipelines. You will own end-to-end processes from extraction to reconciliation, ensuring traceability from every figure to its source document.

You will craft evaluation suites to gate model changes and orchestrate model selection, prompts, and cost constraints across multiple providers. You will integrate AI services into .NET Core back ends and React front ends, and monitor for drift and failure modes

Qualifications

• 5+ years of software engineering experience, with at least one AI feature shipped.
• Ability to explain how you evaluated AI feature effectiveness.
• Portfolio of shipped systems counts more here than credentials.

Responsibilities

• Document AI pipelines: extraction, validation, and reconciliation that turn source documents into structured data.
• Ensure traceability: every figure links back to its source document line.
• Develop evaluation suites and benchmarks to gate model/prompts before production.
• Orchestrate model selection, prompts, and cost/latency budgets across providers.
• Integrate AI services with .NET Core back ends and React front ends.
• Monitor drift and failure modes in live systems and triage monitors.

Skills

LLM engineering

Python

C#

Data schemas

Tools

Git

SQL Server

PostgreSQL

Azure

Azure OpenAI

Job description

Megsoft is seeking an experienced software engineer to design and build production-grade AI pipelines. You will own end-to-end processes from extraction to reconciliation, ensuring traceability from every figure to its source document.

You will craft evaluation suites to gate model changes and orchestrate model selection, prompts, and cost constraints across multiple providers. You will integrate AI services into .NET Core back ends and React front ends, and monitor for drift and failure modes