Production AI Engineer: LLM Systems & Orchestration

Data; Union City (NJ); On-site; USD 120,000 - 150,000; Full time

Job summary

Data in Union City, NJ seeks an AI Engineer to own AI features from day one, guiding architecture and collaborating with senior engineers on AI strategy. You will build LLM-powered capabilities, integrate data sources, and implement robust evaluation and safety guardrails.

You will work with stakeholders to scope problems, compare model providers, and drive improvements in production AI systems while maintaining high engineering standards.

Qualifications

• 2+ years of Python experience and ML fundamentals.
• Hands-on with foundation models and prompt engineering.
• Experience with vector databases and RAG workflows.

Responsibilities

• Build production LLM-powered features with prompt orchestration and tool calling.
• Create API integrations and RAG workflows linking data systems to vector search.
• Develop evaluation infrastructure for prompt regression tests and AI evaluations.
• Monitor production AI features for accuracy, latency, and token costs.
• Implement runtime safety and reliability guardrails.
• Evaluate models and tools; guide final build-versus-buy decisions with leadership.
• Collaborate with non-technical stakeholders to scope AI problems.
• Lead code reviews to raise engineering standards.

Skills

Python

LLM concepts

API integration

Education

Bachelors in CS/Engineering/AI

Tools

LangChain/LlamaIndex

Vector DB (pgvector/OpenSearch)

Job description

Data in Union City, NJ seeks an AI Engineer to own AI features from day one, guiding architecture and collaborating with senior engineers on AI strategy. You will build LLM-powered capabilities, integrate data sources, and implement robust evaluation and safety guardrails.

You will work with stakeholders to scope problems, compare model providers, and drive improvements in production AI systems while maintaining high engineering standards.