Senior AI Engineer – Java/ML for Enterprise Systems

Goldman Sachs Group; New York (NY); On-site; USD 150,000 - 300,000; Full time

Job summary

Goldman Sachs seeks a Senior AI Engineering Expert to architect scalable, production-grade AI solutions within our Java/JVM ecosystem. You will build autonomous AI workflows for collateral management, risk monitoring, and advisor support, integrating with existing microservices and databases.

You will optimize latency, manage costs, and establish governance with HITL and audit-ready logging to meet regulatory standards while advancing real-time AI architectures across the enterprise.

Qualifications

• 6+ years in Java software engineering with 3+ years AI/ML integration in production.
• Experience with RAG workflows and AI integration into microservices.
• Domain knowledge of RIA workflows, collateral eligibility, and asset-based lending regulations.

Responsibilities

• Architect end-to-end AI pipelines (RAG, Agentic workflows) integrated with enterprise APIs and microservices.
• Optimize inference latency and manage token costs for large-scale deployments.
• Establish evaluation frameworks to measure model accuracy and reduce hallucinations.
• Collaborate with tech leads, security leads, and software teams to set technical roadmaps.
• Stay at the forefront of Generative AI, multimodal models, and autonomous agents.
• Build robust RAG systems using Java-based ETL pipelines and vector stores.
• Monitor LLM latency, token usage, and model drift with Spring Boot Actuator and Micrometer.
• Implement HITL patterns for explainable AI decisions in compliance with SEC/FINRA.
• Lead modernization from batch Java processes to real-time, event-driven AI architectures.

Skills

Java 21+

AI frameworks/tools

Spring Boot 3.x

SQL & vector stores

Apache Kafka

RAG pipelines

MLOps concepts

Education

CS / Financial Engineering degree

Tools

Milvus

Weaviate

Pinecone

Job description

Goldman Sachs seeks a Senior AI Engineering Expert to architect scalable, production-grade AI solutions within our Java/JVM ecosystem. You will build autonomous AI workflows for collateral management, risk monitoring, and advisor support, integrating with existing microservices and databases.

You will optimize latency, manage costs, and establish governance with HITL and audit-ready logging to meet regulatory standards while advancing real-time AI architectures across the enterprise.