AI/ML Engineer, Global Banking & Markets, RIA Engineering

Goldman Sachs (lateral)

New York (NY)

On-site

USD 150,000 - 300,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Goldman Sachs is seeking a Senior AI Engineering Expert to architect and implement production-grade AI solutions in a Java/JVM ecosystem. You will build scalable, observable AI workflows that automate collateral management, risk monitoring, and advisor support within enterprise microservices.

The role requires strong Java expertise (21+), experience with AI frameworks, and a focus on low-latency architecture, enabling real-time data-driven decisions in a regulated financial environment.

Qualifications

  • 6+ years in Java software engineering with production AI/ML integration.
  • Experience with scalable, low-latency Java microservices.
  • Knowledge of RAG pipelines and enterprise data integration.

Responsibilities

  • Architect end-to-end AI pipelines (RAG, Agentic workflows) integrating with existing APIs and microservices.
  • Optimize inference latency and manage token costs for large-scale deployments.
  • Establish evaluation frameworks for model accuracy and governance against security standards.
  • Collaborate with tech leads and security teams to drive AI initiatives and roadmaps.
  • Lead modernization of Java processes toward real-time AI architectures using AWS and similar tools.
  • Implement HITL and structured logging for auditable AI-powered decisions.

Skills

Java software engineering
AI/ML integration
System architecture
High concurrency

Education

Degree in Computer Science or related field

Tools

Core Java
AI Frameworks
Spring Boot
JPA
Sybase
Maven/Gradle
SQL
Vector stores (Milvus/Weaviate/Pinecone)
Apache Kafka
RabbitMQ
AWS

Job description

What We Do

At Goldman Sachs, our Engineers don't just make things - we make things possible. Change the world by connecting people and capital with ideas. Solve the most challenging and pressing engineering problems for our clients. Join our engineering teams that build massively scalable software and systems, architect low latency infrastructure solutions, proactively guard against cyber threats, and leverage machine learning alongside financial engineering to continuously turn data into action. Drive new businesses, redefine finance using AI, and seize opportunities at market speed.


In an era defined by AI, Engineering isn't just central - it's the driving force behind our business. Our dynamic environment demands innovative strategic thinking and immediate, impactful solutions. Ready to push the limits of digital possibility? Begin your journey here.


Who We Look For

We are seeking a Senior AI Engineering Expert with deep expertise in leveraging the latest and greatest AI tooling to drive developing solutions on the Java/JVM based ecosystem . You will be responsible for architecting and implementing production-grade AI solutions that integrate directly into our existing Java-based microservices. Your primary focus will be on building scalable, type-safe, and observable AI "Agentic" workflows that automate collateral management, risk monitoring, and advisor support.


How You Will Fulfill Your Potential


  • System Integration: Architect and implement end-to-end AI pipelines (RAG, Agentic workflows) that integrate seamlessly with existing enterprise APIs, legacy databases, and microservices.

  • Scalability & Performance: Optimize inference latency and manage token costs for large-scale deployments serving thousands of internal and external users.

  • Evaluation & Governance: Establish robust evaluation frameworks to measure model accuracy, mitigate hallucinations, and ensure compliance with enterprise security and privacy standards.

  • Cross-Functional Leadership: Collaborate with tech leads, security leads, and software teams to identify high-impact AI use cases and define technical roadmaps.

  • Continuous Innovation: Stay at the forefront of Generative AI, multimodal models, and autonomous agents, recommending strategic pivots as the technology evolves.

  • Enterprise RAG Pipelines: Build robust Retrieval-Augmented Generation (RAG) systems using Java-based ETL pipelines to ingest and index unstructured custodial data (e.g., legal agreements, market news) into vector databases.

  • Performance & Observability: Leverage Spring Boot Actuator and Micrometer to monitor LLM latency, token usage, and model drift within our standard enterprise monitoring stack.

  • Regulatory Compliance (Audit-by-Design): Implement "Human-in-the-Loop" (HITL) patterns and structured logging to ensure all AI-driven lending decisions are explainable and compliant with 2026 SEC/FINRA standards.

  • System Modernization: Lead the transition of traditional batch-oriented Java processes to real-time, event-driven AI architectures using AWS MSK and similar tools.


Required Technical Skills


  • Core Java: Expert-level proficiency in Java 21+ (utilizing Virtual Threads/Project Loom for high-concurrency AI inference).

  • AI Frameworks: Hands-on experience with leading AI frameworks / tools .

  • Enterprise Stack: Deep experience with Spring Boot 3.x , JPA, Sybase , and Maven/Gradle .

  • Data & Search: Proficiency in SQL and integration with enterprise vector stores (e.g., Milvus, Weaviate, or Pinecone) via Java clients.

  • Messaging & Integration: Experience with Apache Kafka or RabbitMQ for orchestrating asynchronous AI agent tasks.

  • Cloud Infrastructure: Deployment experience on AWS using SDKs.


Qualifications


  • Experience: 6+ years in Java software engineering, with at least 3 years focused on AI/ML integration in production.

  • Domain Knowledge: Understanding of RIA workflows, collateral eligibility, and the regulatory landscape of asset-based lending.

  • Education: Degree in Computer Science, Financial Engineering, or a related field.


Salary Range

The expected base salary for this New York, New York, United States-based position is $150,000-$300,000. In addition, you may be eligible for a discretionary bonus if you are an active employee as of fiscal year-end.


Benefits

Goldman Sachs is committed to providing our people with valuable and competitive benefits and wellness offerings, as it is a core part of providing a strong overall employee experience. A summary of these offerings, which are generally available to active, non-temporary, full-time and part-time US employees who work at least 20 hours per week, can be found here .

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Technical AI Solutions Engineer, VP - Global Banking & Markets, RIA Engineering
Technical AI Solutions Engineer, VP - Global Banking & Markets, RIA Engineering

Goldman Sachs • New York (NY)

On-site
USD 150,000 - 300,000
Discretionary bonus
Comprehensive benefits
AI/ML Engineer, Global Banking & Markets, RIA Engineering
AI/ML Engineer, Global Banking & Markets, RIA Engineering

Goldman Sachs Group • New York (NY)

On-site
USD 150,000 - 300,000
AI Engineer for Production ML/LLM Systems (Finance)
AI Engineer for Production ML/LLM Systems (Finance)

Goldman Sachs • Dallas (TX)

On-site
USD 140,000 - 190,000
AI Enabled Modernization - Agentic Software Engineer - Vice President (Seattle, WA)
AI Enabled Modernization - Agentic Software Engineer - Vice President (Seattle, WA)

Goldman Sachs • Seattle (WA)

On-site
USD 150,000 - 250,000
AI-Enabled Software Engineer, Global Banking & Markets
AI-Enabled Software Engineer, Global Banking & Markets

Goldman Sachs Group • New York (NY)

Hybrid
USD 115,000 - 180,000
VP AI/ML Engineer — GenAI for Compliance & Risk
VP AI/ML Engineer — GenAI for Compliance & Risk

Goldman Sachs Group • New York (NY)

Hybrid
USD 130,000 - 250,000
The Core Engineering, New York, Vice President, AI/ML Engineer
The Core Engineering, New York, Vice President, AI/ML Engineer

Goldman Sachs Group • New York (NY)

On-site
USD 130,000 - 250,000
Software Engineer, Global Banking & Markets, AI/ML Technology
Software Engineer, Global Banking & Markets, AI/ML Technology

Goldman Sachs Group • New York (NY)

Hybrid
USD 115,000 - 180,000
Senior Software Engineer, Global Banking & Markets, AI/ML Technology
Senior Software Engineer, Global Banking & Markets, AI/ML Technology

Goldman Sachs (lateral) • New York (NY)

On-site
USD 180,000 - 240,000
Senior Software Engineer, Global Banking & Markets, AI/ML Technology New York · · Vice President
Senior Software Engineer, Global Banking & Markets, AI/ML Technology New York · · Vice President

Goldman Sachs • New York (NY)

On-site
USD 150,000 - 300,000