Senior AI Engineer: Architect Multi-Agent Compliance

Blee, Inc.; San Francisco, Northern (CA, KY); Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Competitive salary with equity

Bi-annual company get-togethers

Fully paid medical, dental, and vision

OneMedical access (US)

Life insurance (US)

401k + matching (US)

Flexible time off (15 days)

Learning opportunities

Job summary

Blee, Inc. is hiring an AI Engineer to architect multi-agent systems that surface, track, and explain compliance flags. You will design and optimize AI/ML pipelines, tune models, and improve explainability across complex workflows.

You’ll work with foundational and custom models, collaborate with product and compliance teams, and help deploy dependable AI features across our platform. This role is based in SF/NY with some remote flexibility.

Qualifications

• 5+ years of applied ML/AI engineering experience.
• Strong knowledge of agent-based architectures and orchestration frameworks.
• Strong Python; APIs, microservices, distributed systems.
• ML frameworks: PyTorch, TensorFlow, Hugging Face.
• LLM experience: fine-tuning, prompt engineering, RAG, evaluation.
• Data preprocessing, feature engineering, and training pipelines.
• Production ML: model serving, monitoring, A/B testing, data pipelines.
• Strong communication skills and ability to work cross-functional.
• Based in the Bay Area or NY & willing to come into the office 3 days a week.

Responsibilities

• Architect multi-agent systems – Design and implement frameworks that integrate foundational LLMs and custom-trained models to power intelligent compliance workflows.
• Build and optimize AI/ML pipelines – Model fine-tuning, prompt engineering, and evaluation frameworks.
• Ensure explainability and traceability – Build mechanisms for transparent flagging, ensuring every compliance flag is traceable to prior rules, examples, or data assets.
• Automate compliance rule translation – Build systems that transform compliance rules into agent-ready logic paths.
• Design, train, and fine‑tune models – Improve compliance accuracy and adaptability using user feedback and outcomes data to drive iterative training and personalization.
• Design model evaluation and monitoring infrastructure – Ensure reliability and auditability across customer deployments.
• Collaborate cross-functionally – Work with Product Engineers to integrate AI features via APIs, data pipelines, and frontend; partner with model training engineers to incorporate feedback loops into system design; collaborate with compliance users to translate complex rules into agent workflows.
• Stay current on AI/ML advances – Prototype and apply new techniques to our platform.

Skills

Python

APIs & microservices

Distributed systems

Communication

Cross-functional collaboration

Tools

PyTorch

TensorFlow

Hugging Face

Job description

Blee, Inc. is hiring an AI Engineer to architect multi-agent systems that surface, track, and explain compliance flags. You will design and optimize AI/ML pipelines, tune models, and improve explainability across complex workflows.

You’ll work with foundational and custom models, collaborate with product and compliance teams, and help deploy dependable AI features across our platform. This role is based in SF/NY with some remote flexibility.