AI/ML Engineer, Global Banking & Markets, RIA Engineering

Goldman Sachs; New York (NY); On-site; USD 150,000 - 300,000; Full time

Benefits offered by this job

Healthcare & Medical Insurance

Vacation & Wellness Programs

Employee Financial Wellness

Job summary

Goldman Sachs is seeking a Senior AI Engineering Expert to architect and deliver production-grade AI solutions on a Java/JVM ecosystem. You will design scalable, observable AI workflows that automate collateral management, risk monitoring, and advisor support within a secure, enterprise-grade stack.

The role emphasizes end-to-end integration, governance, and a modernized real-time architecture. You will lead cross-functional teams, optimize latency and costs, and ensure compliance with

Qualifications

• 6+ years in Java software engineering
• 3+ years AI/ML integration in production
• Knowledge of RIA workflows and collateral eligibility
• Understanding of asset-based lending regulatory landscape

Responsibilities

• Architect end-to-end AI pipelines (RAG, Agentic workflows) with APIs, databases, and microservices.
• Optimize inference latency and token costs for large-scale deployments.
• Establish evaluation frameworks to measure model accuracy and mitigate hallucinations.
• Collaborate with tech leads and teams to define AI roadmaps.
• Lead real-time AI architectures using AWS MSK and event-driven design.
• Build enterprise RAG pipelines feeding vector stores from custodial data.
• Ensure HITL patterns and logs for auditability per SEC/FINRA standards

Skills

Cross-Functional Leadership

Strategic Thinking

Problem Solving

Communication

Education

Degree in Computer Science/Financial Engineering

Tools

Java 21+

Spring Boot 3.x

JPA

SQL

Kafka

RabbitMQ

Milvus/Weaviate/Pinecone

AWS MSK

Spring Boot Actuator

Micrometer

Job description

What We Do

At Goldman Sachs, our Engineers don't just make things – we make things possible.Change the world by connecting people and capital with ideas.Solve the most challenging and pressing engineering problems for our clients. Join our engineering teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Drive new businesses, redefine finance using AI, and seize opportunities at market speed.

In an era defined by AI, Engineering isn't just central – it's driving force behind our business. Our dynamic environment demands innovative strategic thinking and immediate, impactful solutions. Ready to push the limits of digital possibility? Begin your journey here.

Who We Look For

We are seeking aSenior AI Engineering Expertwith deep expertise in leveraging the latest and greatest AI tooling to drive developing solutions on theJava/JVM based ecosystem. You will be responsible for architecting and implementing production-grade AI solutions that integrate directly into our existing Java-based microservices. Your primary focus will be on building scalable, type-safe, and observable AI "Agentic" workflows that automate collateral management, risk monitoring, and advisor support.

How You Will Fulfill Your Potential

• System Integration:Architect and implement end-to-end AI pipelines (RAG, Agentic workflows) that integrate seamlessly with existing enterprise APIs, legacy databases, and microservices.
• Scalability & Performance:Optimize inference latency and manage token costs for large-scale deployments serving thousands of internal and external users.
• Evaluation & Governance:Establish robust evaluation frameworks to measure model accuracy, mitigate hallucinations, and ensure compliance with enterprise security and privacy standards.
• Cross-Functional Leadership:Collaborate with tech leads, security leads, and software teams to identify high-impact AI use cases and define technical roadmaps.
• Continuous Innovation:Stay at the forefront of Generative AI, multimodal models, and autonomous agents, recommending strategic pivots as the technology evolves.
• Enterprise RAG Pipelines:Build robust Retrieval-Augmented Generation (RAG) systems using Java-based ETL pipelines to ingest and index unstructured custodial data (e.g., legal agreements, market news) into vector databases.
• Performance & Observability:LeverageSpring Boot ActuatorandMicrometerto monitor LLM latency, token usage, and model drift within our standard enterprise monitoring stack.
• Regulatory Compliance (Audit-by-Design):Implement "Human-in-the-Loop" (HITL) patterns and structured logging to ensure all AI-driven lending decisions are explainable and compliant with 2026 SEC/FINRA standards.
• System Modernization:Lead the transition of traditional batch-oriented Java processes to real-time, event-driven AI architectures usingAWS MSKand similar tools.

Required Technical Skills

• Core Java:Expert-level proficiency inJava 21+(utilizing Virtual Threads/Project Loom for high-concurrency AI inference).
• AI Frameworks:Hands-on experience withleading AI frameworks / tools.
• Enterprise Stack:Deep experience withSpring Boot 3.x,JPA, Sybase, andMaven/Gradle.
• Data & Search:Proficiency inSQLand integration with enterprise vector stores (e.g., Milvus, Weaviate, or Pinecone) via Java clients.
• Messaging & Integration:Experience withApache KafkaorRabbitMQfor orchestrating asynchronous AI agent tasks.

Qualifications

• Experience:6+ years in Java software engineering, with at least 3 years focused on AI/ML integration in production.
• Domain Knowledge:Understanding of RIA workflows, collateral eligibility, and the regulatory landscape of asset-based lending.
• Education:Degree in Computer Science, Financial Engineering, or a related field.

Please note we will only respond to applications for which we have an interest.

Salary Range

The expected base salary for this New York, New York, United States-based position is $150,000-$300,000. In addition, you may be eligible for a discretionary bonus if you are an active employee as of fiscal year-end.

Benefits

Goldman Sachs is committed to providing our people with valuable and competitive benefits and wellness offerings, as it is a core part of providing a strong overall employee experience. A summary of these offerings, which are generally available to active, non-temporary, full-time and part-time US employees who work at least 20 hours per week, can be found here .

Healthcare & Medical Insurance

We offer a wide range of health and welfare programs that vary depending on office location. These generally include medical, dental, short-term disability, long-term disability, life, accidental death, labor accident and business travel accident insurance.

We offer competitive vacation policies based on employee level and office location. We promote time off from work to recharge by providing generous vacation entitlements and a minimum of three weeks expected vacation usage each year.

Financial Wellness & Retirement

We assist employees in saving and planning for retirement, offer financial support for higher education, and provide a number of benefits to help employees prepare for the unexpected. We offer live financial education and content on a variety of topics to address the spectrum of employees’ priorities.

Health Services

We offer a medical advocacy service for employees and family members facing critical health situations, and counseling and referral services through the Employee Assistance Program (EAP). We provide Global Medical, Security and Travel Assistance and a Workplace Ergonomics Program. We also offer state-of-the‑art on‑site health centers in certain offices.

Fitness

To encourage employees to live a healthy and active lifestyle, some of our offices feature on‑site fitness centers. For eligible employees we typically reimburse fees paid for a fitness club membership or activity (up to a pre‑approved amount).

Child Care & Family Care

We offer on‑site child care centers that provide full‑time and emergency back‑up care, as well as mother and baby rooms and homework rooms. In every office, we provide advice and counseling services, expectant parent resources and transitional programs for parents returning from parental leave. Adoption, surrogacy, egg donation and egg retrieval stipends are also available.

Benefits at Goldman Sachs

Read more about the full suite of class‑leading benefits our firm has to offer.