AI Systems Engineer — LLM Agents & RAG Pipelines

LTM; Berkeley Heights (NJ); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Comprehensive Medical Plan

Short‑Term and Long‑Term Disability Coverage

401(k) plan with company match

Life Insurance

Vacation time, sick leave, paid holidays

Paid paternity and maternity leave

Job summary

A technology company based in Berkeley Heights, New Jersey, seeks an experienced software engineer for LLM-powered applications. The role involves designing agent architectures, developing RAG pipelines for payments workloads, and integrating classical ML models. Ideal candidates will possess strong software engineering skills, experience with multi-agent systems, and a solid understanding of cloud platforms. The company offers a comprehensive benefits package including medical coverage and a 401(k) plan with company match.

Qualifications

• Strong software engineering fundamentals and proficiency in Python, Java, Go, TypeScript.
• Proven experience building LLM powered applications in production.
• Solid understanding of data engineering basics.

Responsibilities

• Design and implement agent architectures and tools.
• Develop RAG pipelines over policies and guidelines.
• Integrate LLM agents with classical ML models.
• Implement safety compliance and responsible AI practices.
• Build CI/CD for agent services and instrument behavior.
• Partner with various teams to convert business problems into AI solutions.

Skills

Software engineering fundamentals

Proficiency in Python

Proficiency in Java

Experience with Codex

Designing distributed systems

Understanding of SQL

Hands-on knowledge of AWS

Experience with multi-agent systems

Familiarity with model evaluation

Tools

Docker

Kubernetes

Kafka

OpenTelemetry

Embedding pipelines

Job description

A technology company based in Berkeley Heights, New Jersey, seeks an experienced software engineer for LLM-powered applications. The role involves designing agent architectures, developing RAG pipelines for payments workloads, and integrating classical ML models. Ideal candidates will possess strong software engineering skills, experience with multi-agent systems, and a solid understanding of cloud platforms. The company offers a comprehensive benefits package including medical coverage and a 401(k) plan with company match.