AI Developer with Java exp in Berkeley Heights, NJ/ Alpharetta, GA

Tech Mirrors; Berkeley Heights (NJ); On-site; USD 120,000 - 160,000; Full time

Job summary

Tech Mirrors is seeking an AI Developer with strong Java experience to join onsite teams in Berkeley Heights, NJ and Alpharetta, GA. You will design autonomous agents, integrate AI into large backend systems, and implement governance and observability across platforms.

The role emphasizes building RAG pipelines with Java/Spring Boot, leveraging LangChain and related tools, and ensuring data privacy and HITL workflows in production environments.

Qualifications

• 3–8+ years of enterprise Java and Spring Boot experience.
• Hands-on with agentic/LLM frameworks like LangChain, LangGraph, AutoGen, or CrewAI.
• Experience building Retrieval-Augmented Generation (RAG) pipelines and connecting with Vector DB.

Responsibilities

• Agent Orchestration: Designing autonomous systems that reason, plan, use tools, and retain contextual memory.
• Enterprise Integration: Embedding AI capabilities into Java/Spring Boot backend architectures.
• Guardrails & Governance: Setting up data privacy filters, prompt injection defenses, and HITL workflows.
• Observability: Building evaluation pipelines to monitor accuracy and latency.

Skills

Core Java

Spring Boot

High-concurrency systems

RAG pipelines

Tools

LangChain

LangGraph

AutoGen

CrewAI

Job description

Title: AI Developer with Java exp

Location: Berkeley Heights, NJ/ Alpharetta, GA (All 5 days Onsite)

Job Description

Key Responsibilities

• Agent Orchestration: Designing autonomous systems that reason, plan, use tools, and retain contextual memory.
• Enterprise Integration: Embedding AI capabilities into massive-scale Java and Spring Boot backend architectures.
• Guardrails & Governance: Setting up data privacy filters, prompt injection defenses, and Human-in-the-Loop (HITL) workflows.
• Observability: Building evaluation pipelines (e.g., DeepEval) to continuously monitor accuracy and latency.

Common Required Skills

• Core Java: 3 to 8+ years of experience in enterprise Java, Spring Boot, and handling high-concurrency distributed systems.
• AI Frameworks: Hands-on expertise with agentic/LLM frameworks like LangChain, LangGraph, AutoGen, or CrewAI.
• Data Handling: Experience building Retrieval-Augmented Generation (RAG) pipelines and connecting with Vector Database.