Open-Source AI Engineer (TypeScript) — LLM Observability

Doist; United States; Remote; USD 185,000 - 200,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k) plan

Unlimited PTO

Parental leave

Wellness support

WFH stipend

Job summary

Arize AI is seeking an Open Source AI Engineer to advance LLM observability, evaluation, and tooling in a fully remote role. You will lead the design of new frameworks, metrics, and pipelines while collaborating with the broader AI open-source community and contributing to practical developer tooling.

You will prototype, benchmark, and document new approaches, helping teams monitor AI performance, reduce hallucinations, and improve model reliability across production deployments.

Qualifications

• Hands-on experience with popular LLM frameworks and prompt engineering.
• Strong proficiency in TypeScript across client/server environments.
• Proven open source contributions and community engagement.
• Experience with ML observability and data dashboards.
• Ability to measure AI performance and iterate on metrics.

Responsibilities

• Design, implement, and open-source LLM observability libraries.
• Collaborate with developers and maintainers in the open source ecosystem.
• Prototype state-of-the-art LLM techniques for tooling.
• Integrate observability features with the Arize platform.
• Write blogs, tutorials, and docs to help the community.

Skills

LLM experience

TypeScript

Open source

ML observability

Data-driven

Job description

Arize AI is seeking an Open Source AI Engineer to advance LLM observability, evaluation, and tooling in a fully remote role. You will lead the design of new frameworks, metrics, and pipelines while collaborating with the broader AI open-source community and contributing to practical developer tooling.

You will prototype, benchmark, and document new approaches, helping teams monitor AI performance, reduce hallucinations, and improve model reliability across production deployments.