Senior AI Engineer, Risk Analytics & LLM Platform

SoFi; San Francisco (CA); On-site; USD 180,000 - 240,000; Full time

Job summary

SoFi is seeking a Senior Staff AI Engineer to shape and lead our risk-focused AI initiatives. You will define the architectural direction for a scalable AI platform, implement sophisticated LLM orchestration, and ensure production-grade reliability.

The role calls for deep expertise in agentic systems, PEFT, and end-to-end AI delivery within a banking context. You will mentor engineers, collaborate across teams, and stay at the forefront of GenAI trends to translate innovation into business

Qualifications

• 8+ years software development experience with production AI applications.
• Expert-level LangGraph to model complex, multi-step reasoning in LLMs.
• Proficient in building agentic solutions with planning, memory, tools.
• Deep knowledge of LLM architectures, prompt engineering, RAG.
• Experience with PEFT techniques (e.g., LoRA) to optimize models.
• Experience with inference engines and Kubernetes/GPU orchestration.
• AI observability, tracing, testing for LLM and agent systems.
• Cloud and container technologies (AWS/Azure/GCP, Docker, Kubernetes).
• Strong Python; React is a plus; data pipelines with Snowflake/DynamoDB.

Responsibilities

• Architect long-term AI platform strategy and scalable frameworks.
• Lead advanced LLM orchestration and multi-stage reasoning across systems.
• Develop persistent agent memory and state across distributed nodes.
• Advance parameter-efficient model tuning to reduce costs.
• Support model serving and low-latency inference across hardware.
• Define AI observability, tracing, and testing practices for production.
• Mentor senior and junior AI engineers and drive cross‑functional alignment.

Skills

LangGraph

LLM Orchestration

PEFT

Distributed Systems

Python

Kubernetes

Cloud (AWS/Azure/GCP)

React

Data handling

Education

Bachelor's or Master's in CS/AI

PhD (plus)

Tools

LangGraph tooling

NVIDIA Triton

vLLM

Elasticsearch / Pinecone / FAISS

Snowflake / DynamoDB

Job description

SoFi is seeking a Senior Staff AI Engineer to shape and lead our risk-focused AI initiatives. You will define the architectural direction for a scalable AI platform, implement sophisticated LLM orchestration, and ensure production-grade reliability.

The role calls for deep expertise in agentic systems, PEFT, and end-to-end AI delivery within a banking context. You will mentor engineers, collaborate across teams, and stay at the forefront of GenAI trends to translate innovation into business