Staff AI Engineer: Production LLMs, Agents & Fine-Tuning

People in AI; New York (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

People in AI is seeking a Staff Software Engineer to lead production AI agents and model adaptation systems in a fast-growing startup environment. You will own LLM strategy, fine-tune models, and architect reliable inference infrastructure while mentoring engineers.

You will work hands-on with Python/PyTorch, explore open-weight models, and guide evaluation pipelines to reduce hallucinations and improve performance in real-world use cases.

Qualifications

• Strong background in applied AI, ML, or software engineering.
• Proven experience fine-tuning LLMs and deploying adapted models in production.
• Experience building production-grade AI agents and evaluation pipelines.
• Excellent Python and PyTorch skills.

Responsibilities

• Own model strategy across LLMs, balancing accuracy, latency, and cost.
• Fine-tune and adapt open-weight models using LoRA, QLoRA, SFT, and preference optimization.
• Design and deploy production AI agents with tool use and orchestration.
• Build evaluation frameworks to measure performance, reliability, and hallucinations.
• Turn real-world feedback into training data and continuous improvements.
• Optimize model serving, inference performance, and quantization.
• Drive technical architecture and mentor engineers.

Skills

Python

PyTorch

LLM fine-tuning

Production systems

Open-weight models

Tools

Hugging Face

DeepSpeed

Ray

LLM evaluation

Job description

People in AI is seeking a Staff Software Engineer to lead production AI agents and model adaptation systems in a fast-growing startup environment. You will own LLM strategy, fine-tune models, and architect reliable inference infrastructure while mentoring engineers.

You will work hands-on with Python/PyTorch, explore open-weight models, and guide evaluation pipelines to reduce hallucinations and improve performance in real-world use cases.