Remote Principal AI Engineer - LLM Systems & Audit Tools

7Seventy; United States; Remote; USD 180.000 - 230.000; Vollzeit

Zusammenfassung

7Seventy seeks a Principal Software Engineer, AI to design, build, and scale production software integrating large language models with deterministic processing for audit workpapers. You will own pipelines from ingestion to review, ensuring accuracy, traceability, and regulatory compliance.

You will partner with CPAs and leadership to set architectural direction, scale the platform from early adopters to thousands of clients, and deliver reliable, auditable software across the workflow.

Qualifikationen

• Experience developing and deploying production large language model (LLM) systems where output accuracy and correctness are critical.
• Hands-on experience with AI extraction pipelines, agentic workflows, document-understanding systems, or comparable production LLM applications.
• Strong software engineering capabilities to design, implement, deploy, and operate complex systems independently.
• Experience developing evaluation frameworks for AI systems, maintaining golden datasets, and detecting regressions before they affect users.
• Ability to measure and assess model output quality through systematic evaluations rather than relying on subjective results.
• Judgment in choosing between probabilistic AI models and deterministic functions for accuracy and compliance.

Aufgaben

• Design, develop, and scale an AI-enabled audit workbench that processes engagement evidence into structured, reviewable audit workpapers.
• Build and maintain document ingestion and information extraction pipelines for processing raw financial and compliance data.
• Develop deterministic recomputation and exception detection logic to validate extracted information and identify discrepancies.
• Implement workpaper generation capabilities that produce consistent, traceable outputs for professional review.
• Maintain evaluation infrastructure for production LLM systems, including golden datasets, regression testing, and quality assessments.
• Develop frontend review interfaces that enable structured human validation, review, and approval of system outputs.
• Establish boundaries between stochastic AI outputs and deterministic code, using exact calculations for regulatory rules.
• Apply language models to extraction and narrative drafting while preserving deterministic controls over accuracy and compliance.

Kenntnisse

Production LLMs

Software architecture

Deterministic processing

Evaluation frameworks

Regulatory compliance

Data validation

Frontend review interfaces

Jobbeschreibung

7Seventy seeks a Principal Software Engineer, AI to design, build, and scale production software integrating large language models with deterministic processing for audit workpapers. You will own pipelines from ingestion to review, ensuring accuracy, traceability, and regulatory compliance.

You will partner with CPAs and leadership to set architectural direction, scale the platform from early adopters to thousands of clients, and deliver reliable, auditable software across the workflow.