Senior AI Systems Engineer - LLMs & Scalable AI Platforms

Openkrill; United States; Remote; USD 140,000 - 210,000; Full time

Job summary

Openkrill in the United States seeks a seasoned software engineer to build shared AI capabilities, scalable services, and AI-driven features across construction software products. You will design and implement production-grade AI systems, including LLM-based experiences, retrieval pipelines, and agentic workflows.

You will create human- and machine-executable artifacts, define evaluation-driven development loops, and collaborate with product teams to identify high-value cross-product

Qualifications

• 5+ years of hands-on software engineering experience in AI or data-intensive systems.
• Strong Python coding skills and cloud experience (Azure/AWS).
• Deep understanding of LLMs, retrieval, tool use, agents, and trade-offs.

Responsibilities

• Design and evolve shared AI capabilities and accelerators across products.
• Implement production-grade AI systems including LLM-based experiences and orchestration layers.
• Create artifacts (specs, evals, interface definitions) to improve clarity and delivery.
• Define evaluation-driven development loops for quality, latency, cost, and reliability.
• Collaborate with product teams to identify cross-product opportunities and patterns.
• Contribute to AI-native engineering practices like Spec-Driven Development and automated testing.
• Establish guardrails for reliability, observability, governance, and security.
• Prototype new approaches and turn AI capabilities into scalable building blocks.
• Mentor engineers and promote knowledge sharing in AI engineering.

Skills

Python

LLMs

Cloud platforms

Retrieval augmentation

Agent workflows

Education

Master's degree in Computer Science / Software Engineering / AI

Tools

APIs

Data pipelines

Retrieval pipelines

Job description

Openkrill in the United States seeks a seasoned software engineer to build shared AI capabilities, scalable services, and AI-driven features across construction software products. You will design and implement production-grade AI systems, including LLM-based experiences, retrieval pipelines, and agentic workflows.

You will create human- and machine-executable artifacts, define evaluation-driven development loops, and collaborate with product teams to identify high-value cross-product