Senior AI Software Engineer - Agentic AI, LangGraph & Azure

City National Bank; Torch of Friendship (FL); Hybrid; USD 150.000 - 210.000; Vollzeit

Zusammenfassung

City National Bank in Florida seeks a Senior AI Software Engineer to architect, develop, and deploy secure, scalable AI applications and agentic workflows. You will own critical components, establish standards, and mentor peers while hands‑on implementing solutions.

The role emphasizes Python, LLM orchestration, RAG, APIs, Azure cloud services, testing, security, and production operations. Hybrid work with leadership collaboration is expected.

Qualifikationen

• Approximately 8 years of hands‑on software engineering with Python.
• Strong architecture, design patterns, concurrency, and API design experience.
• Experience with FastAPI, Pydantic, SQL, Git, pytest, and quality practices.
• Proven ability to design, test, deploy, and troubleshoot production services.

Aufgaben

• Architect and deliver production-grade AI applications and agentic workflows.
• Lead LangGraph/LangChain implementations and multi-step agentic processes.
• Implement secure APIs, identity controls, and enterprise integration patterns.
• Ensure reliability, observability, scalability, and cost awareness.
• Mentor engineers, perform code reviews, and collaborate across teams.

Kenntnisse

Python

FastAPI

LangGraph

LangChain

RAG

Azure

LLM orchestration

APIs

Security

Testing

CI/CD

PostgreSQL

Docker

Kubernetes

Ausbildung

Bachelor's degree in CS/SE

Master's degree in CS/SE/AI

Tools

Docker

Kubernetes

Azure OpenAI

SQL

Git

pytest

Pydantic

Azure AI Search

AKS

Jobbeschreibung

Senior AI Software Engineer - Agentic AI, LangGraph & Azure

Type: Full-Time. Workplace policy: Hybrid.

Overview

City National Bank of Florida is seeking a highly experienced, hands-on Senior AI Software Engineer to architect, develop, and deploy secure, scalable, production-grade AI applications and agentic workflows.

This engineer will take technical ownership of critical AI application components, establish engineering standards, mentor other developers through code reviews and design collaboration, and turn business requirements into reliable software.

The role requires deep Python engineering capability alongside practical experience with LLM orchestration, RAG, APIs, Azure cloud services, testing, security, and production operations. The successful candidate must be comfortable designing the solution and implementing it personally.

What You'll Do:

• Design and implement production-grade AI applications and backend services using Python, FastAPI, and modern software engineering practices.
• Lead the technical implementation of stateful, multi-step agentic workflows using LangGraph and LangChain v1.
• Implement graph state management, conditional routing, checkpointing, retries, recovery, idempotency, and controlled execution.
• Build enterprise RAG architectures incorporating ingestion, chunking, embeddings, Azure AI Search, hybrid retrieval, reranking, metadata filtering, and source-grounded generation.
• Integrate Azure OpenAI, enterprise APIs, document repositories, databases, and internal systems using secure API contracts.
• Design and implement MCP servers and tools, with authentication, authorization, input validation, and appropriate access controls.
• Build reusable application components, API interfaces, shared libraries, and common AI engineering patterns.
• Implement human-in-the-loop approval gates, workflow state persistence, audit trails, and prevention of unauthorized downstream actions.
• Establish automated quality gates for unit testing, integration testing, retrieval evaluation, agent behavior, security, and regression testing.
• Engineer for reliability, scalability, latency, cost, observability, and maintainability.
• Implement secure cloud application patterns using Azure identity, managed identities, Key Vault, network controls, and appropriate secrets management.
• Containerize and deploy services through CI/CD pipelines to Azure Container Apps (ACA), with Azure Kubernetes Service (AKS) where workload requirements justify it.
• Integrate Azure Monitor and application telemetry for logs, metrics, tracing, incident investigation, and operational support.
• Review code, guide implementation decisions, troubleshoot complex production defects, and mentor other engineers while remaining an active developer.
• Work with AI leadership, application teams, architecture, cybersecurity, model risk, legal, and business stakeholders to deliver governed banking AI solutions.

Qualifications

Software engineering

• Approximately 8 years of professional software engineering experience, including substantial hands-on Python development.
• Strong understanding of software architecture, design patterns, SOLID principles, concurrency, asynchronous programming, API design, and distributed systems.
• Experience with FastAPI or an equivalent backend framework, Pydantic, SQL, Git, pytest, and automated code-quality practices.
• Demonstrated ability to design, implement, test, deploy, and troubleshoot production services.

Agentic AI and RAG

• Hands-on experience delivering LLM-powered applications beyond proof-of-concept demonstrations.
• Strong practical knowledge of LangGraph and LangChain or equivalent frameworks, with direct LangGraph experience strongly preferred.
• Experience with stateful workflows, tool calling, conditional execution, structured outputs, retries, failure recovery, and human approval patterns.
• Strong knowledge of end-to-end RAG, embeddings, vector and hybrid search, reranking, grounding, and retrieval evaluation.
• Experience designing repeatable LLM evaluation and regression-testing strategies.
• Ability to diagnose hallucinations, retrieval failures, prompt-injection risks, tool misuse, and inconsistent agent behavior.

Azure and production engineering

• Hands-on experience with Azure OpenAI and preferably Azure AI Search.
• Experience with Azure identity and security services, including managed identities and Key Vault.
• Experience with Docker, CI/CD, cloud deployments, automated testing, monitoring, and production troubleshooting.
• Experience building secure APIs and integrating enterprise systems.
• Strong understanding of authentication, authorization, least privilege, data protection, and auditability.

Preferred qualifications

• Production experience implementing MCP servers and secure enterprise tools.
• Experience with Azure Container Apps and Azure Kubernetes Service.
• Experience with PostgreSQL or Azure Database for PostgreSQL, persistent workflow state, and object storage.
• Experience with enterprise document processing and financial data extraction.
• Experience with OpenTelemetry, distributed tracing, AI observability, latency optimization, and token-cost management.
• Banking or other regulated-industry experience, especially credit, lending, fraud, or risk workflows.
• Experience with model governance, explainability, human oversight, and responsible AI practices.

Education

• Bachelor's or master's degree in Computer Science, Software Engineering, AI, or a related field, or equivalent practical experience.

Special Instructions to Candidates

Equal Opportunity

City National Bank of Florida is an Equal Opportunity Employer. We do not discriminate based on race, color, religion, sex, national origin, age, disability, genetic information, protected veteran status, or any status protected by federal, state, or Florida law. We comply with the ADA and applicable Florida laws.

Interview Guidelines

To ensure a fair and consistent interview process, applicants are not permitted to use AI-enabled devices during interviews, including AI glasses or similar wearable technology that can record, transmit, or generate real-time information.

Applicants who require a reasonable accommodation to participate in the interview process should contact [e-mail] in advance of the interview to submit an accommodation request. City National Bank of Florida will engage in the interactive process and provide reasonable accommodations in accordance with applicable law.