Production LLM Engineer - Fully Remote

Externo; United States; Remote; USD 150,000 - 230,000; Full time

Benefits offered by this job

Fully remote

Job summary

Externo is seeking a hands-on engineer to design and ship LLM-powered features and agents with a focus on real-world reliability. The role covers from early experimentation to production deployment in a fully remote setting open to candidates worldwide.

You will build, evaluate, and monitor AI components, collaborate with product and engineering teams, and iterate toward robust production systems that behave predictably in real-world constraints.

Qualifications

• Hands-on experience building applications on top of large language models.
• Strong engineering fundamentals and end-to-end production readiness.
• Familiarity with evaluation, prompt design, and common LLM orchestration patterns.

Responsibilities

• Build and iterate on LLM features and agent workflows for production use.
• Evaluate model behavior under realistic conditions and harden systems against failure modes.
• Collaborate with engineering and product to ship capabilities from idea to production.
• Instrument, monitor, and refine deployed AI components based on observed performance.

Skills

LLM development

Production engineering

Prompt design

Evaluation & monitoring

Job description

Externo is seeking a hands-on engineer to design and ship LLM-powered features and agents with a focus on real-world reliability. The role covers from early experimentation to production deployment in a fully remote setting open to candidates worldwide.

You will build, evaluate, and monitor AI components, collaborate with product and engineering teams, and iterate toward robust production systems that behave predictably in real-world constraints.