Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)

Oscilar

United States

Remote

USD 180,000 - 240,000

Full time

30 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Competitive compensation & equity
Remote-first culture
US health insurance and benefits
Unlimited PTO

Job summary

Oscilar is seeking a US-based Engineering Manager for AI Agents to lead a team building and operating production agent systems at the heart of our Agentic Risk Platform. You will own technical and people leadership for agent orchestration, tool-calling, evals, reliability, and observability, partnering with product, FDE, and core platform engineering.

This hands-on leadership role requires shipping production-grade agent systems, managing growth, and driving reliability in fraud, AML, and

Qualifications

  • Significant hands-on software engineering experience with a track record of shipping production systems.
  • Proven experience building and shipping agent systems in production, including tool-calling, orchestration, evals, and reliability engineering.
  • Experience managing and building engineering teams of 5+ people, including hiring, coaching, and raising technical standards.
  • Experience at a growing startup or scale-up, fast-moving and able to create structure where needed.
  • Strong technical judgment for evaluating architectures, design, failure modes, and engineering quality.
  • Excellent written and verbal communication, partnering across product, data science, and distributed teams.
  • Experience with reliability, observability, and production operations for complex AI or distributed systems.
  • Fintech, fraud, credit risk, AML, compliance, or regulated industries is a plus.
  • Prior experience with MCP, multi-agent orchestration, or large-scale agent evaluation systems is highly valued.
  • Tech stack: LangGraph (or similar), AWS Bedrock, Python + Java, MCP.

Responsibilities

  • Team leadership: Build, lead, and grow a high-performing engineering team focused on AI agent systems.
  • Production agent systems: Drive design, development, and continuous improvement of production agent capabilities including orchestration, tool-calling, evals, reliability, and observability.
  • Technical quality: Raise architecture and reliability standards and ownership for agent systems used in regulated environments.
  • Cross-functional impact: Partner with Forward-Deployed Engineers and customer teams to deploy agents in customer environments.
  • Operational excellence: Establish planning, execution, and incident processes for predictable delivery and post-incident learning.
  • Talent & leadership development: Recruit senior ICs and emerging leaders and foster growth.
  • Scale & reliability: Ensure AI agent systems meet performance, security, auditability, and reliability standards for financial institutions.

Skills

Hands-on engineering
Agent systems in production
Team leadership (5+)
Startup/scale-up experience
Reliability & observability
MCP / multi-agent orchestration
Strong communication

Tools

MCP
LangGraph
AWS Bedrock
Python
Java

Job description

Engineering Manager - AI Agents (Agent Platform, LLMs, Evals)

Shape the future of trust in the age of AI

At Oscilar, we're building the most advanced AI Risk Decisioning™ Platform. Banks, fintechs, and digitally native organizations rely on us to manage their fraud, credit, and compliance risk with the power of AI. If you're passionate about solving complex problems and making the internet safer for everyone, this is your place.

Why join us:
  • Mission-driven teams: Work alongside industry veterans from Meta, Uber, Citi, and Confluent, all united by a shared goal to make the digital world safer.

  • Ownership and impact: We believe in extreme ownership. You'll be empowered to take responsibility, move fast, and make decisions that drive our mission forward.

  • Innovate at the cutting edge: Your work will shape how modern finance detects fraud and manages risk.

Background

Oscilar is seeking a US-based Manager of AI Agents to lead a team of engineers building and operating the production agent systems at the heart of our Agentic Risk Platform.

In this role, you will own the technical and people leadership for a team focused on agent orchestration, tool-calling, evaluation frameworks, reliability, and observability. You will partner closely with product, FDE and core platform engineering to raise the bar on what production-grade agents can deliver for fraud, AML, credit, and onboarding use cases.

This is a hands-on leadership role for someone who has been a software engineer, has shipped real agent systems in production, and has successfully built and managed engineering teams at a growing start-up or scale-up. The right person is energized by technical depth, operational excellence, and turning ambitious agent ideas into reliable, customer-facing systems.

Responsibilities
  • Team leadership: Build, lead, and grow a high-performing team of engineers focused on AI agent systems. Hire, coach, and develop talent while establishing strong technical and cultural standards. Create an environment where strong engineers want to stay and grow.

  • Production agent systems: Drive the design, development, and continuous improvement of production agent capabilities including orchestration, tool-calling (including MCP and related protocols), evaluation frameworks, reliability, observability, and safe failure modes. Agents are built on a governed platform where every new agent inherits shared evals, guardrails, and auditability.

  • Technical quality and judgment: Raise the bar on architecture, design quality, reliability, and service ownership for agent systems that operate in high-stakes, regulated environments.

  • Cross-functional impact: Partner with Forward-Deployed Engineers and customer teams to ship agents into customer environments and turn field feedback into platform improvements.

  • Operational excellence: Establish clear planning, execution, and incident processes that support predictable delivery without unnecessary overhead. Own reliability and post-incident learning for agent systems.

  • Talent and leadership development: Recruit senior individual contributors and emerging leaders. Create an environment where strong engineers want to stay and grow.

  • Scale and reliability: Ensure AI agent systems meet the performance, security, auditability, and reliability standards required by financial institutions that rely on our platform to process billions of risk decisions.

Requirements
  • Significant hands-on software engineering experience, with a track record of shipping production systems.

  • Proven experience building and shipping agent systems in production, including hands-on work with tool-calling, orchestration, evaluation frameworks (evals), and reliability engineering.

  • Experience managing and building engineering teams of 5+ people (direct reports or equivalent), including hiring, coaching, and raising technical standards.

  • Experience at a growing startup or scale-up, with comfort operating in fast-moving, ambiguous environments and creating structure where needed.

  • Strong technical judgment and enough depth to evaluate agent architectures, system design, failure modes, and engineering quality with credibility.

  • Excellent written and verbal communication skills, with experience partnering across product, data science, and distributed teams.

  • Experience with reliability, observability, and production operations for complex AI or distributed systems.

  • Experience in fintech, fraud, credit risk, AML, compliance, or other regulated industries is a strong plus.

  • Prior experience with Model Context Protocol (MCP), multi-agent orchestration, or large-scale agent evaluation systems is highly valued.

  • Our Tech stack: LangGraph (or similar agent frameworks), AWS Bedrock, Python + Java, MCP

This is a remote senior engineering leadership role based in the US. You will report into engineering leadership and have direct ownership of a critical part of Oscilar’s agent platform.

Benefits
  • Compensation: Competitive salary and equity packages, including a 401k

  • Flexibility: Remote-first culture — work from anywhere

  • Health: Comprehensive health, dental, and vision insurance with a top tier plan for you and your dependents (US)

  • Balance: Unlimited PTO policy

  • Technical: AI First company; both Co-Founders are engineers at heart; and over 50% of the company is Engineering and Product

  • Culture: Family-Friendly environment; Regular team events and offsites

  • Development: Unparalleled learning and professional development opportunities

  • Impact: Making the internet safer by protecting online transactions

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Sr./Staff Backend Engineer - Java
Sr./Staff Backend Engineer - Java

Oscilar • United States

Remote
USD 120,000 - 200,000
VP of Brand and Communications
VP of Brand and Communications

Oscilar • United States

Remote
USD 180,000 - 300,000
VP of Brand Marketing (Brand, PR & Communications)
VP of Brand Marketing (Brand, PR & Communications)

Oscilar • United States

Remote
USD 250,000 - 350,000
Competitive salary and equity
Remote-first culture
Health, dental, and vision insurance (
+4
Remote Engineering Manager - AI Agents & Platform
Remote Engineering Manager - AI Agents & Platform

Oscilar • United States

Remote
USD 180,000 - 240,000
Competitive compensation & equity
Remote-first culture
US health insurance and benefits
+1
TAM Director
TAM Director

Oscilar • United States

Remote
USD 180,000 - 240,000
Compensation
Flexibility
Health and vision insurance (US)
+4
Technical Account Manager
Technical Account Manager

Oscilar • United States

Remote
USD 140,000 - 210,000
401k plan
Health insurance
Unlimited PTO
+1
Product Manager - AML
Product Manager - AML

Oscilar • United States

Remote
USD 140,000 - 220,000
Remote work
Equity
401k
+3
Technical Account Manager
Technical Account Manager

Digitailor • United States

Remote
USD 120,000 - 180,000
Health insurance
401k plan
Unlimited PTO
+1
Enterprise Account Executive (Southeast)
Enterprise Account Executive (Southeast)

Oscilar • United States

Remote
USD 120,000 - 190,000
401k plan
Remote first culture
Health, dental, vision insurance
Enterprise Account Executive (West)
Enterprise Account Executive (West)

Oscilar • United States

Remote
USD 120,000 - 180,000
401k plan
Remote-first culture
Health, dental and vision insurance
+4