Prompt Engineer

Odiin.AI; New York (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

A software development company in New York is seeking a Mid-Senior Level role focusing on AI-driven solutions. You will design and optimize prompts for LLMs and collaborate with AI teams to enhance production workflows. Ideal candidates should have expertise in generative AI models, Python, and various AI integration tools. Strong analytical skills are essential to evaluate and refine AI outputs. This contract position offers a unique opportunity to contribute to innovative AI applications.

Qualifications

• Strong experience working with LLMs and generative AI models.
• Familiarity with Python and AI integration tools.
• Understanding of AI workflows and retrieval pipelines.
• Experience evaluating AI outputs and defining quality metrics.
• Knowledge of retrieval pipelines and RAG concepts.

Responsibilities

• Design, test, and optimise prompts for AI models.
• Collaborate with AI/ML teams on production workflows.
• Evaluate and refine prompts to improve accuracy and safety.
• Develop and maintain prompt libraries, templates, and guidelines for internal teams.
• Research and implement best practices in prompt engineering, chain-of-thought reasoning, and context management.
• Work on evaluation frameworks to measure prompt performance, reliability, and fairness.
• Assist in building retrieval-augmented generation (RAG) pipelines or other hybrid AI systems.

Skills

Working with LLMs

Python

AI integration tools

Analytical skills

Evaluating AI outputs

Tools

Hugging Face

LangChain

LlamaIndex

OpenAI GPT

Job description

You will work closely with AI researchers, data scientists, and product teams to build reliable, high‑performing AI‑driven solutions.

Responsibilities

• Design, test, and optimise prompts for LLMs, generative AI models, and other AI applications.
• Collaborate with AI/ML teams to integrate prompt‑based systems into production workflows.
• Evaluate model outputs and iteratively refine prompts to improve accuracy, relevance, and safety.
• Develop and maintain prompt libraries, templates, and guidelines for internal teams.
• Research and implement best practices in prompt engineering, chain‑of‑thought reasoning, and context management.
• Work on evaluation frameworks to measure prompt performance, reliability, and fairness.
• Assist in building retrieval‑augmented generation (RAG) pipelines or other hybrid AI systems.

Requirements

• Strong experience working with LLMs (OpenAI GPT, LLaMA, Claude, etc.) and generative AI models.
• Familiarity with Python and AI integration tools (Hugging Face, LangChain, LlamaIndex, etc.).
• Understanding of AI workflows, vector databases, and retrieval pipelines.
• Strong analytical and problem‑solving skills.
• Experience evaluating AI outputs and designing metrics for quality and relevance.

Seniority level

Mid‑Senior level

Employment type

Contract

Job function

Information Technology

Industries

Software Development

New York, United States