Senior AI Engineer - Java & Enterprise Pipelines

Goldman Sachs (lateral); New York (NY); On-site; USD 150,000 - 300,000; Full time

Job summary

Goldman Sachs in New York is seeking a Senior AI Engineering Expert to architect and implement production-grade AI solutions within Java/JVM microservices. You will build scalable, observable agentic workflows for collateral management, risk monitoring, and advisor support, integrating with enterprise APIs and ETL pipelines.

You will lead end-to-end AI pipelines (RAG), optimize latency and token cost, govern model evaluation, and ensure regulatory compliance while partnering with security and

Qualifications

• 6+ years in Java software engineering with AI/ML integration in production.
• Experience with RAG, agentic AI workflows and enterprise APIs.
• Strong knowledge of Spring Boot, JPA, and databases.
• Familiarity with vector stores and latency optimization.

Responsibilities

• Architect end-to-end AI pipelines integrating with enterprise APIs and microservices.
• Optimize inference latency and manage token costs for large-scale deployments.
• Establish evaluation frameworks to measure model accuracy and ensure compliance with security/privacy standards.
• Lead cross-functional teams to define AI roadmaps and priorities.
• Build RAG systems ingesting custodial data into vector databases.
• Monitor latency, token usage, and model drift within the enterprise monitoring stack.
• Implement 'Human-in-the-Loop' patterns for audit-by-design and regulatory standards.
• Modernize Java processes to real-time, event-driven AI architectures on AWS MSK.

Skills

Core Java

AI frameworks

Spring Boot 3.x

JPA

Sybase

Maven/Gradle

SQL

Vector stores

Kafka

RabbitMQ

AWS

Education

Java experience

AI/ML in production

RIA workflows knowledge

Collateral eligibility knowledge

Regulatory knowledge (asset lending)

CS/FE degree

Tools

Spring Boot 3.x

JPA

Sybase

Maven/Gradle

Milvus/Weaviate/Pinecone

Job description

Goldman Sachs in New York is seeking a Senior AI Engineering Expert to architect and implement production-grade AI solutions within Java/JVM microservices. You will build scalable, observable agentic workflows for collateral management, risk monitoring, and advisor support, integrating with enterprise APIs and ETL pipelines.

You will lead end-to-end AI pipelines (RAG), optimize latency and token cost, govern model evaluation, and ensure regulatory compliance while partnering with security and