AI / LLM Engineer

Externo; United States; Remote; USD 150,000 - 230,000; Full time

Benefits offered by this job

Fully remote

Job summary

Externo is seeking a hands-on engineer to design and ship LLM-powered features and agents with a focus on real-world reliability. The role covers from early experimentation to production deployment in a fully remote setting open to candidates worldwide.

You will build, evaluate, and monitor AI components, collaborate with product and engineering teams, and iterate toward robust production systems that behave predictably in real-world constraints.

Qualifications

• Hands-on experience building applications on top of large language models.
• Strong engineering fundamentals and end-to-end production readiness.
• Familiarity with evaluation, prompt design, and common LLM orchestration patterns.

Responsibilities

• Build and iterate on LLM features and agent workflows for production use.
• Evaluate model behavior under realistic conditions and harden systems against failure modes.
• Collaborate with engineering and product to ship capabilities from idea to production.
• Instrument, monitor, and refine deployed AI components based on observed performance.

Skills

LLM development

Production engineering

Prompt design

Evaluation & monitoring

Job description

Role overview

This position centers on designing and shipping LLM-powered features and agents that hold up beyond demos and prototypes. The work spans early experimentation through production deployment, with a strong emphasis on real-world reliability. It is a full-time, fully remote role open to candidates worldwide.

Responsibilities

• Build and iterate on LLM features and agent workflows intended for production use.
• Evaluate model behavior under realistic conditions and harden systems against common failure modes.
• Collaborate with engineering and product partners to take capabilities from idea to shipped.
• Instrument, monitor, and refine deployed AI components based on observed performance.

Requirements

• Hands-on experience building applications on top of large language models.
• Strong engineering fundamentals and the ability to take work end to end through production.
• Familiarity with evaluation, prompt design, and common LLM orchestration patterns.
• A pragmatic mindset for shipping AI systems that behave predictably under real-world constraints.

Benefits and work setup

• Full-time, fully remote position available to candidates globally.