Senior AI Systems Engineer – Production LLMs & RAG

JPMorgan Chase & Co.; Plano (TX); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorgan Chase & Co. is seeking an experienced AI software engineer in Plano to enhance product lines with AI-driven features and production-grade AI applications.

You will design, build, and deploy LLM-powered workflows, RAG solutions, and agentic systems, while ensuring enterprise controls, observability, and secure tool execution. The role emphasizes responsible AI practices, cloud-native deployment, and scalable architectures, partnering with product, risk, legal, and engineering teams to

Qualifications

• Formal training or certification in software engineering concepts.
• 5+ years of applied engineering experience.
• Hands-on experience delivering AI-powered features in production or near-production environments (LLMs, RAG, agents, workflow automation, or decision support systems).
• Strong proficiency in Python (and ability to build maintainable services, libraries, and pipelines).
• Experience building APIs and services using Django, FastAPI, or similar frameworks.
• Experience building modern UIs using React or similar frameworks.
• Strong system design skills with an emphasis on secure distributed systems, reliability, and operational excellence.
• Practical understanding of Responsible AI / model risk concepts (evaluation, guardrails, privacy, bias, explainability where applicable, and safe deployment practices).
• Experience implementing observability (logging, metrics, tracing) and AI-specific monitoring (quality, drift signals, latency, cost, error rates).
• Experience with cloud platforms (AWS preferred) and containerized deployments.
• Strong problem-solving skills with a structured, evidence-based approach; comfortable operating in ambiguity and delivering iteratively.

Responsibilities

• Enhance multiple products across the product line by identifying, prioritizing, and delivering AI-driven features that improve user experience, efficiency, and operational resilience.
• Design, build, and deploy production-grade AI applications including LLM-powered workflows, Retrieval-Augmented Generation (RAG) solutions, and agentic systems.
• Build agentic workflows with enterprise-ready controls (identity, authorization, guardrails, tracing, evaluation, and auditability).
• Develop automation solutions that reduce manual effort and eliminate recurring operational issues, including self-healing patterns and intelligent triage.
• Architect AI systems with production concerns in mind: latency, scalability, cost management, model selection, observability, reliability, and failure modes (including hallucinations and tool errors).
• Establish and apply AI engineering standards across the product line (prompting patterns, RAG design standards, evaluation practices, logging/telemetry, and release readiness criteria).
• Drive AI architecture reviews and contribute to reference architectures for model hosting, orchestration, data access, and secure tool execution.
• Identify and mitigate risks across the AI lifecycle including data privacy, security, bias, model misuse, prompt injection, and third-party/vendor risk, and ensure appropriate documentation and controls.
• Partner with product, design, risk, legal/compliance, and engineering stakeholders to align on outcomes, constraints, and measurable success metrics.
• Lead technical evaluations with vendors and platform providers; assess capabilities, integration fit, security posture, and total cost of ownership.
• Research emerging AI capabilities (models, frameworks, tools) and translate findings into practical guidance, prototypes, and adoption recommendations.
• Educate and enable teams through documentation, workshops, design reviews, and coaching to raise AI fluency and delivery consistency across the organization.
• Execute creative software solutions, technical troubleshooting, and hands-on development; write secure, high-quality production code and review/debug code written by others.
• Influence stakeholders and drive alignment across teams without direct authority, owning outcomes end-to-end.

Skills

Python

APIs & services

Secure distributed systems

Observability

Cloud platforms

Containerized deployments

Web UI integration

Problem solving

Education

Software engineering training

Tools

Django

FastAPI

LangChain

LlamaIndex

Semantic Kernel

CrewAI

Databricks

Job description

JPMorgan Chase & Co. is seeking an experienced AI software engineer in Plano to enhance product lines with AI-driven features and production-grade AI applications.

You will design, build, and deploy LLM-powered workflows, RAG solutions, and agentic systems, while ensuring enterprise controls, observability, and secure tool execution. The role emphasizes responsible AI practices, cloud-native deployment, and scalable architectures, partnering with product, risk, legal, and engineering teams to