Director - Applied AI ML (Software Engineering/Data & Agentic Systems)

United States Digital Space LLC; Karnataka; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

J.P. Morgan is seeking an Applied GenAI Engineering Director to lead the design and delivery of scalable GenAI capabilities. You will partner with agile teams to build production-grade agentic workflows, reusable golden paths, and secure, governance-driven systems across multiple portfolios.

The role requires deep software/data engineering expertise, strong communication to senior stakeholders, and a focus on measurable business impact, cost, and latency tradeoffs.

Qualifications

• 10+ years in software and/or data engineering building production systems.
• Hands-on GenAI systems to production, including RAG and evaluation/monitoring.
• Experience building agentic workflows with tooling and guardrails.

Responsibilities

• Establish a library of reusable GenAI/ML assets and templates.
• Lead creation of end-to-end GenAI toolchains, data pipelines, and governance.
• Build agentic GenAI workflows with proper guardrails and observability.
• Design GenAI evaluation loops and continuous monitoring for CI/CD.
• Advise on strategy across multiple GenAI products and platforms.
• Act as lead advisor on feasibility and business value for use cases.
• liaise with AI/ML stakeholders to drive standards and reuse.
• Communicate complex tradeoffs to senior leadership for decisions.
• Mentor engineers to elevate delivery and engineering standards.
• Champion diversity, inclusion, and respectful collaboration.

Skills

GenAI engineering

Distributed systems

LangChain

AWS cloud

Data architecture

Cross-functional leadership

Python/Java

Education

Bachelor's/Master's in CS

Tools

LangGraph

Job description

JOB DESCRIPTION

Join our innovative team and shape the future of software development with AI-driven solutions.

As an Applied GenAI Engineering Director within the Ai4Tect Team at the company, you will leverage deep software engineering and data engineering expertise to design, build, and deliver trusted, secure, stable, and scalable GenAI capabilities. You will partner with agile engineering teams to create production-grade agentic workflows and RAG-based systems, and to establish reusable frameworks ("golden paths"), shared components, and best practices that accelerate delivery and ensure consistency across business functions. You will stay current on GenAI engineering trends and translate complex technical tradeoffs into clear guidance for senior stakeholders, enabling informed decisions and measurable business impact.

Job Responsibilities

• Establish and promote a library of reusable GenAI/ML engineering assets, including reference implementations, standardized templates/SDKs, shared RAG components (ingestion, chunking, embedding, indexing, retrieval), and deployment patterns.
• Lead the creation of shared tools and platforms that streamline the end-to-end lifecycle for GenAI applications, including data pipelines, orchestration, evaluation, monitoring/telemetry, and release governance.
• Build and operationalize agentic GenAI workflows (planning/execution patterns, tool calling, state management, retries) with appropriate guardrails, permissions, and observability.
• Design and implement Generative AI evaluation and feedback loops (offline test suites, human review where needed, continuous evaluation, telemetry-based monitoring, regression gating in CI/CD).
• Advise on strategy and development across multiple GenAI products, applications, and technology portfolios—focusing on common capabilities that scale across teams rather than one-off solutions.
• Serve as a lead advisor on technical feasibility and business value for GenAI use cases, driving build‑vs‑buy decisions and pragmatic solution designs.
• Liaise with firmwide AI/ML stakeholders to drive standards, interoperability, adoption, and reuse of shared frameworks.
• Communicate complex technical issues and tradeoffs (quality vs latency vs cost; evaluation design; governance; security) to leadership to support well‑informed strategic decisions.
• Influence across business, product, and technology teams; effectively manage senior stakeholder relationships; mentor engineers and practitioners to raise engineering and delivery standards.
• Champion the firm's culture of diversity, opportunity, inclusion, and respect.

Required qualifications, capabilities, and skills

• 10+ years of applied experience in software engineering and/or data engineering using Python, Java, or similar languages, building production distributed systems end‑to‑end.
• Hands‑on experience designing and delivering GenAI systems to production, including RAG (embeddings, retrieval/indexing) and evaluation/monitoring.
• Hands‑on experience building agentic workflows (tool calling, orchestration, state, retries, guardrails) using frameworks such as LangChain/LangGraph or equivalent.
• Strong understanding of data architecture and engineering (lakehouse/data platform concepts), including data quality, lineage/metadata, idempotent pipelines, backfills, and governance/PII controls relevant to GenAI.
• Strong cloud‑native experience on AWS, including secure deployment and operations (e.g., EKS and/or managed services), plus cost/latency management.
• Proven ability to translate complex technical issues to senior stakeholders; excellent communication, attention to detail, and follow‑through.

Preferred qualifications, capabilities, and skills

• Bachelor's/Master's degree in Computer Science (or equivalent practical experience).
• Working knowledge of PyTorch or TensorFlow (enough to partner effectively with ML practitioners).
• Experience with ML/GenAI evaluation automation and CI/CD quality gates (beyond basic offline testing).

ABOUT US

the company, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

ABOUT THE TEAM

J.P. Morgan's Commercial & Investment Bank is a global leader across banking, markets, securities services and payments. Corporations, governments and institutions throughout the world entrust us with their business in more than 100 countries. The Commercial & Investment Bank provides strategic advice, raises capital, manages risk and extends liquidity in markets around the world.