LLM-Powered AI Engineer for Production Apps (Onsite NYC)

Staffxpert LLC; New York (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

STAFFXPERT LLC in Manhattan, NY seeks an Applied AI Engineer to build and deploy LLM-powered applications onsite. The ideal candidate will lead AI workflows, agent-based patterns, and production-grade AI systems, collaborating with Product, Engineering, Data Science, UX, Security, and business teams.

The role sits at the intersection of AI engineering and software development, focusing on scalable architectures, Python services, tooling, evaluation, observability, and reliability.

Qualifications

• 6+ years in software/AI engineering roles.
• Hands-on with LLM-powered apps in production.
• Experience designing cloud-native AI architectures.

Responsibilities

• Build and iterate on AI-powered applications and workflows using LLMs, RAG, tool calling, and agent-based patterns.
• Develop scalable orchestration layers for prompting, retrieval, context management, and tool integration.
• Apply prompt engineering and multi-step workflow techniques to production AI applications.
• Work with frameworks and technologies such as LangChain, LangGraph, LlamaIndex, MCP, OpenAI APIs, Anthropic APIs, and AWS/Azure/GCP.
• Design and implement cloud-native AI application architectures.
• Develop scalable production services and APIs using Python.
• Support AI engineering enablement by helping teams integrate AI/ML into products.
• Contribute to reusable AI tooling, standards, and best practices.
• Develop evaluation, monitoring, and observability capabilities for AI apps.
• Collaborate with data scientists, ML engineers, product managers, designers, and business stakeholders.
• Translate customer challenges into technical AI solutions and safe workflows.
• Create technical documentation, sample apps, tutorials, and guides.
• Participate in experimentation, testing, and production support for LLM-based applications.

Skills

LLM-powered apps

Python

Cloud-native

AI workflows

LangChain

LangGraph

LLamaIndex

OpenAI APIs

Anthropic APIs

MCP

AWS

Azure

GCP

Tool integration

Tools

OpenAI APIs

Anthropic APIs

MCP

AWS

Azure

GCP

Job description

STAFFXPERT LLC in Manhattan, NY seeks an Applied AI Engineer to build and deploy LLM-powered applications onsite. The ideal candidate will lead AI workflows, agent-based patterns, and production-grade AI systems, collaborating with Product, Engineering, Data Science, UX, Security, and business teams.

The role sits at the intersection of AI engineering and software development, focusing on scalable architectures, Python services, tooling, evaluation, observability, and reliability.