AI Engineer (LLM Applications)

Windmill Technology; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Job summary

Windmill Technology is seeking an engineer to design and deliver applications powered by large language models, focusing on retrieval-augmented generation and agent-based workflows. You will build backend services that bring model capabilities into real product features.

You will create evaluation pipelines, practice solid prompt engineering, and optimize operating costs while ensuring quality and reliability across deployments.

Qualifications

• Hands-on experience with LLM applications or ML systems.
• Fluent Python proficiency.
• Experience with at least one web backend framework.
• Understanding of prompt engineering, evaluation, and cost optimization.

Responsibilities

• Build and deploy LLM application systems, including RAG and agent workflows.
• Create evaluation pipelines for model outputs and behavior.
• Apply prompt design and evaluation to improve performance.
• Consider cost and efficiency when shaping model-powered features.
• Connect AI capabilities to product use cases via backend development.

Skills

Fluent Python

LLM applications

Web backend frameworks

Prompt engineering

Cost optimization

Job description

Role overview

Design and deliver applications built around large language models, turning model capabilities into useful product features. The work spans retrieval-augmented generation, agent-based systems, evaluation workflows, and deployment, with attention to application quality and operating cost.

Responsibilities

• Build and deploy LLM application systems, including RAG and agent workflows.
• Create evaluation pipelines to assess application behavior and model output.
• Apply prompt design and evaluation practices to improve system performance.
• Consider cost and efficiency when shaping and operating model-powered features.
• Connect AI capabilities to product use cases through backend application development.

Requirements

• Hands-on experience with LLM applications or machine-learning systems; personal projects are acceptable.
• Fluent Python skills.
• Experience with at least one web backend framework.
• Practical understanding of prompt engineering, evaluation, and cost optimization.

Benefits and work setup

• Full-time remote role open to candidates in Taiwan or working remotely.