AI Engineer

Ruby Labs Ltd; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Ruby Labs Ltd. in the United States seeks a Senior AI Engineer to enhance AI infrastructure through advanced prompt engineering and model optimization using a modern tech stack. You will focus on dynamic prompting and LLM observability to improve system reliability and performance.

The role emphasizes building robust evaluation pipelines, running A/B tests, and making data-driven deployment decisions based on rigorous benchmarks and quantitative analysis.

Qualifications

• Role requires expertise in AI infrastructure, prompt engineering, and LLM observability.
• Experience with evaluation pipelines and deterministic outputs is beneficial.

Responsibilities

• Enhance AI infrastructure with advanced prompt engineering and model optimization.
• Implement response schemes and evaluation pipelines to ensure AI outputs integrate with application logic.
• Deep debug of LLM chains and conduct A/B tests to compare model performance.

Job description

Ruby Labs seeks a Senior AI Engineer to enhance AI infrastructure through advanced prompt engineering and model optimization using a modern tech stack. Ideal candidates are experienced in dynamic prompting and LLM observability.

In this role, you will focus on optimizing AI models and their performance through advanced prompt engineering and structured outputs. You will implement various response schemes and build robust evaluation pipelines to ensure AI outputs integrate seamlessly into application logic.

You will also be responsible for deep debugging of LLM chains and running A/B tests to compare model performance. The role emphasizes data-driven decision-making, requiring you to analyze results quantitatively and make deployment decisions based on solid benchmarks.