Remote AI Engineer — Build LLM Apps & RAG Solutions

Windmill Technology; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote work

Flexible hours

Job summary

Windmill Technology is seeking an engineer to design and deliver applications powered by large language models, focusing on retrieval-augmented generation and agent-based workflows. You will build backend services that bring model capabilities into real product features.

You will create evaluation pipelines, practice solid prompt engineering, and optimize operating costs while ensuring quality and reliability across deployments.

Qualifications

• Hands-on experience with LLM applications or ML systems.
• Fluent Python proficiency.
• Experience with at least one web backend framework.
• Understanding of prompt engineering, evaluation, and cost optimization.

Responsibilities

• Build and deploy LLM application systems, including RAG and agent workflows.
• Create evaluation pipelines for model outputs and behavior.
• Apply prompt design and evaluation to improve performance.
• Consider cost and efficiency when shaping model-powered features.
• Connect AI capabilities to product use cases via backend development.

Skills

Fluent Python

LLM applications

Web backend frameworks

Prompt engineering

Cost optimization

Job description

Windmill Technology is seeking an engineer to design and deliver applications powered by large language models, focusing on retrieval-augmented generation and agent-based workflows. You will build backend services that bring model capabilities into real product features.

You will create evaluation pipelines, practice solid prompt engineering, and optimize operating costs while ensuring quality and reliability across deployments.