AI Platform Engineer - LLMs & Data Systems

JPMorgan Chase & Co.; Plano (TX); On-site; USD 110,000 - 160,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a Software Engineer III to advance secure, scalable AI-enabled platforms within Consumer & Community Banking.

You will collaborate across product, data, security, and risk teams to design and deploy trusted technology products. As a core technical contributor, you will build reusable services for LLM-powered agents, implement evaluation and monitoring, and ensure robust security and governance in production environments while maintaining high code quality and

Qualifications

• Formal training or certification on software engineering concepts.
• 3+ years applied experience in software engineering.
• Proficiency in Python with strong fundamentals including testing, VCS, and code review.
• Experience building and operating production services with reliability focus.
• Hands-on ML/LLM delivery in production environments, with monitoring.
• Experience using AI-assisted dev tools and establishing validation standards.
• Understanding of responsible AI, data sensitivity, and secure adoption practices.
• Knowledge of prompt engineering and retrieval-augmented generation (RAG).
• Ability to design maintainable systems and balance speed, risk, and sustainability.
• Strong communication and cross-team collaboration skills.

Responsibilities

• Deliver end-to-end platform features for AI-enabled use cases from design to production deployment.
• Drive team adoption of enterprise AI-assisted engineering practices to improve quality and speed.
• Apply SDLC tools and AI-assisted development to improve automation value.
• Build and maintain reusable services for LLM-powered agents at scale.
• Develop evaluation, testing, and quality measurement for LLM systems.
• Develop observability (tracing, metrics, logs) to support operations and troubleshooting.
• Apply security, governance-by-design patterns including guardrails and access controls.
• Collaborate with product managers to define success metrics and prioritize work.
• Partner with engineering, data, security, and risk stakeholders to ensure secure, scalable solutions.
• Produce clear documentation and reference implementations to accelerate adoption.

Skills

Python programming

Software engineering fundamentals

Testing practices

Code reviews

AI-assisted development

Secure development

Prompt engineering

Collaboration

Education

Software engineering certification

Tools

Docker

Kubernetes

LangGraph

LlamaIndex

CI/CD tooling

Databricks

Job description

JPMorgan Chase & Co. is seeking a Software Engineer III to advance secure, scalable AI-enabled platforms within Consumer & Community Banking.

You will collaborate across product, data, security, and risk teams to design and deploy trusted technology products. As a core technical contributor, you will build reusable services for LLM-powered agents, implement evaluation and monitoring, and ensure robust security and governance in production environments while maintaining high code quality and