Senior AI Engineer: Scalable LLM Apps & AI Platforms

RESOURCESOFT, INC.; New York (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

Resourcesoft, Inc. in New York is seeking an experienced AI/ML software engineer to build production-grade LLM applications, backend services, and AI-enabled systems. You will integrate with OpenAI/Anthropic APIs and architect cloud-native solutions, collaborating across product, data science, UX, and security teams.

The role emphasizes scalable design, testing, guardrails, and reusable AI patterns, with opportunities to influence enterprise workflows and operational excellence.

Qualifications

• 6+ years of software or AI engineering experience building production-grade LLM applications and services.
• Proficiency in Python for developing scalable backend services, APIs, and AI-enabled applications.
• Experience with LangChain, LangGraph, LlamaIndex, OpenAI APIs, Anthropic APIs, MCP, or comparable AI frameworks.
• Experience in RAG, prompt engineering, tool calling, agent workflows, context management, and structured generation.
• Experience with cloud-native AI architecture, deployment, evaluation, observability, and monitoring on AWS, Azure, or GCP.
• Excellent verbal and written communication skills.

Responsibilities

• Build and deploy scalable LLM applications, AI assistants, agent workflows, and automation solutions.
• Develop orchestration layers supporting prompting, retrieval, context handling, and external tool integration.
• Prototype and refine AI solutions based on enterprise workflows, stakeholder feedback, and operational challenges.
• Implement testing, evaluation, guardrails, monitoring, and performance improvements for production AI systems.
• Create reusable AI engineering patterns, SDK examples, technical guides, and enablement materials.
• Partner with product, engineering, data science, UX, security, and subject-matter teams on AI delivery.

Skills

Communication

Problem-solving

Collaboration

Tools

Python

LangChain

LangGraph

LlamaIndex

OpenAI APIs

Anthropic APIs

MCP

Tool calling

Agent workflows

Context management

Structured generation

Cloud-native AI

AWS

Azure

GCP

Job description

Resourcesoft, Inc. in New York is seeking an experienced AI/ML software engineer to build production-grade LLM applications, backend services, and AI-enabled systems. You will integrate with OpenAI/Anthropic APIs and architect cloud-native solutions, collaborating across product, data science, UX, and security teams.

The role emphasizes scalable design, testing, guardrails, and reusable AI patterns, with opportunities to influence enterprise workflows and operational excellence.