Principal AI Engineer - Lead LLM Platform & Innovation

Next Frontier Capital; Palo Alto (CA); On-site; USD 210,000 - 290,000; Full time

Job summary

JPMorganChase seeks a Principal Software Engineer in AI/ML & Data Platforms for LLM Suite, leading a technical area across teams and projects. You will mentor engineers and drive scalable ML solutions with operational excellence.

You will design agentic AI architectures, implement production-grade code, build LLM APIs, and own the full ML lifecycle from experimentation to deployment, ensuring security and governance at scale.

Qualifications

• Formal training or certification on software engineering concepts and 7+ years applied experience.
• Strong Python engineering skills with PyTorch or TensorFlow experience.
• Expertise with vector storage and memory design for agents.
• Experience deploying LLM-backed services to production (APIs, microservices).
• Deep MLOps experience: CI/CD, monitoring, incident response, governance.
• Cloud-native AI deployment (AWS or Azure) with cost/performance optimization.
• Commitment to responsible AI practices and operational excellence.
• Strong cross-functional collaboration with product, risk, legal and compliance.
• Experience leading adoption of agentic AI development practices and human-in-the-loop validation.

Responsibilities

• Design and implement agentic AI architectures including orchestration, memory, guardrails and evaluation harnesses.
• Write production-quality Python code (PyTorch or TensorFlow) and review critical-path code.
• Create reusable components for prompt management, evaluators, safety filters, connectors and embeddings pipelines.
• Build and operate LLM-powered APIs and microservices integrated into advisor, client, and internal workflows.
• Own the end-to-end ML lifecycle: experimentation, CI/CD, automated testing, monitoring, drift detection and rollback.
• Optimize inference for latency, throughput, caching, batching, model selection and cost per inference.
• Partner with data teams on data pipelines, document ingestion, metadata and access controls.
• Set engineering standards for agentic AI systems and lead design reviews.
• Influence roadmap and priorities through technical insight and delivery.
• Architect and govern agentic AI-enabled engineering workflows with guardrails for security and reuse.

Skills

Python engineering

PyTorch

TensorFlow

ML engineering

MLOps

APIs & microservices

Cloud deployment

Agent memory design

CI/CD

Security & governance

Job description

JPMorganChase seeks a Principal Software Engineer in AI/ML & Data Platforms for LLM Suite, leading a technical area across teams and projects. You will mentor engineers and drive scalable ML solutions with operational excellence.

You will design agentic AI architectures, implement production-grade code, build LLM APIs, and own the full ML lifecycle from experimentation to deployment, ensuring security and governance at scale.