Java AI Engineer — Production-Ready AI Agents & LLM Apps

Advanced Tech Placement

Alpharetta (GA)

On-site

USD 140,000 - 210,000

Full time

4 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Advanced Tech Placement is seeking a Java AI / Agent Engineer to build AI-powered solutions for enterprise clients. This hands-on role sits at the intersection of robust backend Java engineering and applied AI, focusing on production-ready AI agents and LLM-powered applications.

The ideal candidate will have strong Java/Spring experience and have deployed AI agents or LLM applications to production, working directly in Java to develop agents that can use tools, manage context, handle failures,

Qualifications

  • Strong professional experience with Java (Java 21+).
  • Experience with Spring Boot 3.x and production APIs/backend services.
  • Strong understanding of software engineering fundamentals, testing, debugging, and API design.

Responsibilities

  • Design, build, and deploy AI agents and agentic workflows using Java 21+, Spring Boot 3.x, Spring AI, or LangChain4j.
  • Build production APIs and backend services using Spring Web, Spring Data, and Spring Security.
  • Implement agent capabilities including tool calling, orchestration, memory/context, multi-step workflows, retries, and guardrails.
  • Design prompts and structured outputs and apply RAG, including embeddings, chunking, vector databases, and retrieval optimization.
  • Design and maintain LLM evaluations (evals) to measure quality, reliability, and performance.
  • Evaluate and select AI models based on quality, latency, cost, and risk.
  • Optimize LLM applications for performance and cost, including caching, batching, model routing, and prompt/token optimization.
  • Implement LLM observability and monitoring using tools such as Langfuse, Arize, Weights & Biases, Datadog, or similar.
  • Use AI coding tools such as GitHub Copilot, Amazon Q, or Claude Code throughout development, testing, debugging, and refactoring.
  • Collaborate with engineers and stakeholders to prototype, test, and continuously improve AI capabilities while maintaining clean, well-tested Java code.

Skills

Java
Spring Boot
API design
Testing
Debugging
Backend development

Tools

LangChain4j
Spring AI
GitHub Copilot
Copilot CLI

Job description

Advanced Tech Placement is seeking a Java AI / Agent Engineer to build AI-powered solutions for enterprise clients. This hands-on role sits at the intersection of robust backend Java engineering and applied AI, focusing on production-ready AI agents and LLM-powered applications.

The ideal candidate will have strong Java/Spring experience and have deployed AI agents or LLM applications to production, working directly in Java to develop agents that can use tools, manage context, handle failures,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Engineer — Production-Grade LLM & Agent Systems
AI Engineer — Production-Grade LLM & Agent Systems

Awareson Sp. z o.o. • United States

Remote
USD 120,000 - 160,000
AI/Java Engineer
AI/Java Engineer

New York Technology Partners • United States

On-site
USD 120,000 - 150,000
Java Back-End Engineer – AI Technologies
Java Back-End Engineer – AI Technologies

Moofwd, Inc. • O’Fallon (MO)

Hybrid
USD 140,000 - 180,000
Backend AI Engineer
Backend AI Engineer

Advanced Tech Placement • Alpharetta (GA)

On-site
USD 140,000 - 210,000
AI-Driven Java Developer for LLM Apps
AI-Driven Java Developer for LLM Apps

Cloud Analytics Technologies, LLC • Denver (CO)

On-site
USD 90,000 - 130,000
AI Solution Architect: Build Production-Grade LLM & Agents
AI Solution Architect: Build Production-Grade LLM & Agents

Accrescent Group • Jersey City (NJ)

On-site
USD 150,000 - 190,000
Senior AI Agentic Engineer: Production-Ready LLM Agents
Senior AI Agentic Engineer: Production-Ready LLM Agents

MTech Systems USA LLC • Dunwoody (GA)

On-site
USD 180,000 - 240,000
Agentic AI Engineer — Build Production LLM Agents
Agentic AI Engineer — Build Production LLM Agents

SR2 • New York (NY)

On-site
USD 150,000 - 210,000
Equity
Location: New York City 5 days in‑lab
Healthcare: comprehensive
+2
Senior AI/ML Engineer: LLM Agents & Production Systems
Senior AI/ML Engineer: LLM Agents & Production Systems

InfoVision Inc. • Denver (CO)

On-site
USD 140,000 - 180,000
GenAI Java Developer: LLMs, RAG & Agents
GenAI Java Developer: LLMs, RAG & Agents

Artifintech • Richardson (TX)

On-site
USD 86,000 - 123,000