AI Software Engineer — LLM & Agent Orchestration

Entrata; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

Entrata seeks an AI Software Engineer to build and operate production-grade LLM and agent systems. You will design agent graphs, prompts, and memory strategies, and integrate AWS Bedrock into scalable workflows. Collaborate with product and data science teams to deliver reliable AI features.

You will work on retrieval, grounding, evaluation, and observability, ensuring secure and efficient AI-driven functionality across the platform.

Qualifications

• 1–4 years in software engineering or related fields; 2+ years with AI or data science technologies.
• Strong proficiency in Python, JavaScript, or TypeScript.
• Proven experience building and operating LLM or agentic systems in production.
• Deep understanding of prompting, tool calling, structured outputs, and memory management.
• Experience designing agent graphs, multi-step workflows, and failure-handling behavior.
• Experience evaluating models for task-specific performance, latency, cost, and reliability.

Responsibilities

• Build, deliver, and maintain production-grade LLM, agent, retrieval, and ML workflows.
• Design and maintain agent graphs, states, routing, and tool integrations.
• Develop prompting strategies, response schemas, and guardrails for multi-agent systems.
• Configure memory, context, and privacy boundaries for context handling.
• Select and configure models based on task requirements and constraints.
• Integrate AWS AI services (Bedrock) and platform capabilities into AI systems.
• Design robust retrieval/grounding strategies and evaluation suites.
• Investigate unexpected agent behavior using traces and production data.

Skills

Python

JavaScript/TypeScript

LLM/agent systems

Prompting & structured outputs

Memory management

Model evaluation & grounding

System design & ownership

Tools

Node.js

Amazon Bedrock

AgentCore

CI/CD

Cloud platforms

Job description

Entrata seeks an AI Software Engineer to build and operate production-grade LLM and agent systems. You will design agent graphs, prompts, and memory strategies, and integrate AWS Bedrock into scalable workflows. Collaborate with product and data science teams to deliver reliable AI features.

You will work on retrieval, grounding, evaluation, and observability, ensuring secure and efficient AI-driven functionality across the platform.