Senior AI Engineer – Java/JVM, Scalable AI Pipelines

Goldman Sachs; New York (NY); On-site; USD 150,000 - 300,000; Full time

Benefits offered by this job

Healthcare & Medical Insurance

Vacation & Wellness Programs

Employee Financial Wellness

Job summary

Goldman Sachs is seeking a Senior AI Engineering Expert to architect and deliver production-grade AI solutions on a Java/JVM ecosystem. You will design scalable, observable AI workflows that automate collateral management, risk monitoring, and advisor support within a secure, enterprise-grade stack.

The role emphasizes end-to-end integration, governance, and a modernized real-time architecture. You will lead cross-functional teams, optimize latency and costs, and ensure compliance with

Qualifications

• 6+ years in Java software engineering
• 3+ years AI/ML integration in production
• Knowledge of RIA workflows and collateral eligibility
• Understanding of asset-based lending regulatory landscape

Responsibilities

• Architect end-to-end AI pipelines (RAG, Agentic workflows) with APIs, databases, and microservices.
• Optimize inference latency and token costs for large-scale deployments.
• Establish evaluation frameworks to measure model accuracy and mitigate hallucinations.
• Collaborate with tech leads and teams to define AI roadmaps.
• Lead real-time AI architectures using AWS MSK and event-driven design.
• Build enterprise RAG pipelines feeding vector stores from custodial data.
• Ensure HITL patterns and logs for auditability per SEC/FINRA standards

Skills

Cross-Functional Leadership

Strategic Thinking

Problem Solving

Communication

Education

Degree in Computer Science/Financial Engineering

Tools

Java 21+

Spring Boot 3.x

JPA

SQL

Kafka

RabbitMQ

Milvus/Weaviate/Pinecone

AWS MSK

Spring Boot Actuator

Micrometer

Job description

Goldman Sachs is seeking a Senior AI Engineering Expert to architect and deliver production-grade AI solutions on a Java/JVM ecosystem. You will design scalable, observable AI workflows that automate collateral management, risk monitoring, and advisor support within a secure, enterprise-grade stack.

The role emphasizes end-to-end integration, governance, and a modernized real-time architecture. You will lead cross-functional teams, optimize latency and costs, and ensure compliance with