Senior AI Engineer: Agentic Finance AI & LLM Systems

Aimlroles; New York (NY); Remote; USD 130,000 - 150,000; Full time

Benefits offered by this job

Compensation & Equity

Career Growth Opportunities

Paid Time Off

Health Coverage

FSA / HSA Options

Parental Leave

Wellness Programs

Pre-tax Commuter Benefits

Job summary

Chaos Labs is seeking a Senior AI Engineer to design agentic systems powering Chaos AI. You will work where LLMs meet financial data and production infrastructure, building intelligent agents that reason, plan, and execute across complex workflows.

Ideal candidates have 5+ years in software and 2+ years in production AI, with Python, API design, and LangGraph experience plus a track record in LLM evaluation pipelines. Competitive compensation and equity offered.

Qualifications

• Must have 5+ years in software engineering with 2+ years building production AI/ML systems.
• Hands-on experience with agentic architectures and tool calling.
• Experience with LangGraph or equivalent agentic frameworks.
• Experience designing and operating LLM evaluation pipelines.
• Strong Python and API design skills; familiarity with RAG pipelines and vector databases.

Responsibilities

• Design and build single and multi-agent systems with planning, memory, and tool use.
• Build and operate MCP servers with secure schemas and permissions.
• Develop agentic workflows using LangGraph or equivalent frameworks.
• Integrate LLMs via SDKs; manage prompts, structured outputs, and tool calling.
• Define and run LLM evaluations for quality, correctness, latency, cost, and regressions.
• Build observability and reliability infrastructure: logging, tracing, retries, state management.
• Optimize performance and cost from prototype to production.
• Mentor engineers and establish agentic best practices.

Skills

Python

API design

Agentic architectures

Tool calling

LangGraph

LLM evaluation

Production AI/ML systems

MCP servers

Vector databases

Tools

LangGraph

MCP servers

LLM evaluation pipelines

Job description

Chaos Labs is seeking a Senior AI Engineer to design agentic systems powering Chaos AI. You will work where LLMs meet financial data and production infrastructure, building intelligent agents that reason, plan, and execute across complex workflows.

Ideal candidates have 5+ years in software and 2+ years in production AI, with Python, API design, and LangGraph experience plus a track record in LLM evaluation pipelines. Competitive compensation and equity offered.