Senior AI Engineer – Java Systems & Generative AI

Goldman Sachs; New York (NY); On-site; USD 150,000 - 300,000; Full time

Benefits offered by this job

Discretionary bonus

Comprehensive benefits

Job summary

Goldman Sachs is seeking a Senior AI Engineering Expert to design and implement production-grade AI solutions integrated into Java-based microservices. You will build scalable, observable Agentic workflows that automate collateral management, risk monitoring, and advisor support within a large enterprise environment.

You will lead end-to-end AI pipelines, optimize latency, manage token costs, and ensure governance and compliance across enterprise systems using Spring Boot and modern AI tooling.

Qualifications

• 6+ years in Java software engineering with AI/ML integration in production.
• Understanding of RIAs, collateral workflows, and asset-based lending regulations.
• Degree in Computer Science, Financial Engineering, or related field.

Responsibilities

• System Integration: architect end-to-end AI pipelines (RAG, Agentic) with APIs and microservices.
• Scalability: optimize latency and token costs for large-scale deployments.
• Evaluation & Governance: measure model accuracy and ensure security/compliance.
• Cross-Functional Leadership: lead with tech leads and software teams.
• Continuous Innovation: stay ahead in Generative AI and autonomous agents.
• Enterprise RAG Pipelines: build Java-based ETL to index custodial data into vectors.
• Performance & Observability: monitor latency, token usage, model drift with Spring Boot Actuator.

Skills

Core Java

AI frameworks

Enterprise stack

Data & search

Messaging & integration

Cloud infrastructure

Education

Degree in Computer Science or related

Tools

Milvus

Weaviate

Pinecone

Apache Kafka

RabbitMQ

AWS SDKs

Job description

Goldman Sachs is seeking a Senior AI Engineering Expert to design and implement production-grade AI solutions integrated into Java-based microservices. You will build scalable, observable Agentic workflows that automate collateral management, risk monitoring, and advisor support within a large enterprise environment.

You will lead end-to-end AI pipelines, optimize latency, manage token costs, and ensure governance and compliance across enterprise systems using Spring Boot and modern AI tooling.