Senior AI Engineer: Prompting & Model Optimization

Ruby Labs Ltd; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Ruby Labs Ltd. in the United States seeks a Senior AI Engineer to enhance AI infrastructure through advanced prompt engineering and model optimization using a modern tech stack. You will focus on dynamic prompting and LLM observability to improve system reliability and performance.

The role emphasizes building robust evaluation pipelines, running A/B tests, and making data-driven deployment decisions based on rigorous benchmarks and quantitative analysis.

Qualifications

• Role requires expertise in AI infrastructure, prompt engineering, and LLM observability.
• Experience with evaluation pipelines and deterministic outputs is beneficial.

Responsibilities

• Enhance AI infrastructure with advanced prompt engineering and model optimization.
• Implement response schemes and evaluation pipelines to ensure AI outputs integrate with application logic.
• Deep debug of LLM chains and conduct A/B tests to compare model performance.

Job description

Ruby Labs Ltd. in the United States seeks a Senior AI Engineer to enhance AI infrastructure through advanced prompt engineering and model optimization using a modern tech stack. You will focus on dynamic prompting and LLM observability to improve system reliability and performance.

The role emphasizes building robust evaluation pipelines, running A/B tests, and making data-driven deployment decisions based on rigorous benchmarks and quantitative analysis.