Senior AI/ML Engineer - Enterprise LLM Platform Lead

Aumni; Jersey City (NJ); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorgan Chase in Jersey City seeks an Software Engineer III to design and deliver agentic AI platforms and LLM-enabled services for Finance use cases. You will contribute to technical design, build cloud-native services on AWS, and improve system quality via observability and strong code reviews.

Responsibilities include building scalable AI components, embeddings, guardrails, and tool integrations, plus collaboration across product and platform teams to ensure reliable, secure delivery and

Qualifications

• 3+ years of applied software engineering experience and formal training or certification in software concepts.
• Hands-on experience building and operating production large language model applications, including agentic patterns and tool integrations.
• Strong fundamentals to deliver cloud-native services on AWS using containers and serverless designs.
• Advanced Python programming with production-quality code.
• Experience with retrieval-augmented generation, embeddings, semantic search and context engineering.
• Proficiency building React front ends that integrate backend APIs with reliability, security, and performance.
• Experience in evaluation, testing, monitoring practices for AI system quality and reliability.
• Ability to troubleshoot complex distributed systems and asynchronous workflows.
• Strong collaboration to communicate decisions and trade-offs clearly to partners.
• Understanding of responsible AI, data sensitivity, secure handling and resiliency.

Responsibilities

• Design and implement scalable agentic AI platforms for enterprise workflows.
• Build production-grade AI systems including agents, skills, memory patterns, guardrails, and tool-use orchestration.
• Implement retrieval and context-engineering patterns with embeddings and semantic search.
• Engineer cloud-native services on AWS with containers and serverless architectures.
• Optimize latency, throughput, caching, and cost for large language model workloads.
• Develop secure, reusable APIs and integrations to enterprise platforms.
• Implement evaluation, experimentation, testing, and observability signals.
• Collaborate with product and engineering teams to translate requirements into deliverables.
• Contribute to design reviews, documentation, and peer code reviews.
• Leverage AI-assisted development tools and ensure outputs are validated for correctness, performance, and security.

Skills

Large language models

Python programming

AWS cloud

React frontend

Distributed systems

Code reviews

Observability

Collaboration

Tools

Kubernetes

Docker

Git

Cloud orchestration

Job description

JPMorgan Chase in Jersey City seeks an Software Engineer III to design and deliver agentic AI platforms and LLM-enabled services for Finance use cases. You will contribute to technical design, build cloud-native services on AWS, and improve system quality via observability and strong code reviews.

Responsibilities include building scalable AI components, embeddings, guardrails, and tool integrations, plus collaboration across product and platform teams to ensure reliable, secure delivery and