Senior AI Platform Engineer - Enterprise LLMs

Next Frontier Capital; Jersey City (NJ); On-site; USD 170,000 - 210,000; Full time

Job summary

JPMorganChase is seeking an experienced Software Engineer III to design and deliver agentic AI platforms and LLM-enabled services within Enterprise Technology. You will build cloud-native AWS solutions, drive architecture decisions, and improve system quality through observability and robust code reviews.

You will work end-to-end, from design to production readiness, collaborating with product and engineering teams to deliver resilient, measurable outcomes across enterprise workflows.

Qualifications

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Hands-on experience building and operating production large language model applications, including agentic patterns and tool integrations.
• Strong software engineering skills with experience delivering cloud-native services on AWS using containers and serverless architectures.
• Experience with retrieval-augmented generation approaches, including embeddings and semantic search, and practical context engineering.
• Proficiency building APIs and service integrations with strong attention to reliability, security, and performance.
• Experience establishing or contributing to evaluation, testing, and monitoring practices for AI system quality and reliability.
• Ability to troubleshoot complex issues across distributed systems, including asynchronous workflows and event-driven architectures.
• Strong collaboration skills with the ability to communicate technical decisions and trade-offs clearly to partners.
• Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment with demonstrated ability to validate AI outputs.
• Understanding of responsible AI use in engineering workflows, including data sensitivity considerations and secure handling.

Responsibilities

• Design scalable, reliable agentic AI platforms for enterprise workflows.
• Build production-grade AI systems including agents, skills, memory patterns, guardrails, and tool-use orchestration.
• Implement retrieval and context-engineering patterns including embeddings, semantic search, grounding, summarization, and prompt management.
• Engineer cloud-native services on AWS using containers, serverless compute, and event-driven messaging patterns.
• Optimize latency, throughput, scalability, caching, and cost across LLM workloads.
• Develop secure, reusable APIs and integrations with enterprise platforms.
• Implement evaluation, testing, and observability signals to improve AI quality and agent behavior.
• Collaborate with product, platform, and engineering teams to translate requirements into deliverables.
• Contribute to design reviews, documentation, and peer code reviews for quality.

Skills

Software engineering concepts

LLM applications

AWS cloud-native

Retrieval-augmented generation

APIs & integrations

AI evaluation & monitoring

Distributed systems

Collaboration

AI-assisted development

Responsible AI

Tools

Kubernetes

Docker

Job description

JPMorganChase is seeking an experienced Software Engineer III to design and deliver agentic AI platforms and LLM-enabled services within Enterprise Technology. You will build cloud-native AWS solutions, drive architecture decisions, and improve system quality through observability and robust code reviews.

You will work end-to-end, from design to production readiness, collaborating with product and engineering teams to deliver resilient, measurable outcomes across enterprise workflows.