Software Engineer II

JPMorganChase; Jersey City (NJ); On-site; USD 140,000 - 200,000; Full time

Benefits offered by this job

On-site health and wellness centers

Retirement savings plan

Tuition reimbursement

Mental health support

Financial coaching

Backup childcare

Job summary

JPMorganChase is seeking an AI Platform Engineer to help shape how teams build AI agents. You will contribute to SDKs, orchestration, and robust production-ready components, improving reliability and developer experience across the firm.

You will work on retrieval/grounding, testing, observability, and documentation while collaborating with cross-functional teams to deliver scalable solutions and high-quality code.

Qualifications

• Formal training or certification on software engineering concepts and 2+ years applied experience.
• Two or more years of hands-on Python development experience delivering production software.
• Experience building and operating backend services or platform components with attention to reliability, performance, and maintainability.
• Experience writing automated tests and using version control and code review practices to maintain quality.
• Experience integrating application components with data sources and building robust error-handling and observability practices.
• Ability to break down ambiguous problems into clear deliverables, iterate quickly, and communicate trade-offs to partners.
• Strong collaboration and communication skills, with a focus on outcomes and continuous improvement.

Responsibilities

• Build core SDK features and reusable components that enable teams to compose and operate AI agents consistently and safely.
• Implement orchestration and tool/function-calling patterns that improve reliability, traceability, and developer experience.
• Develop retrieval and grounding capabilities that connect agents to approved data sources and reduce incorrect or unsupported responses.
• Create evaluation datasets, benchmarks, and quality metrics to measure capability accuracy and guide iterative improvements.
• Add testing, observability, and monitoring features (tracing, logs, latency and cost metrics) to improve operability and incident readiness.
• Partner with cross-functional stakeholders to translate requirements into secure, scalable, production-ready solutions.
• Contribute to documentation, examples, and reference implementations that accelerate adoption and consistent usage.
• Participate in code reviews and design discussions to improve maintainability, performance, and overall engineering standards.

Skills

Python development

Backend services

Testing and code review

Observability

Data integration

Problem breakdown

Communication and collaboration

Education

Software engineering training or certification

Tools

Version control

CI/CD

Cloud platforms (AWS)

Job description

Help shape how teams across the firm build AI agents by contributing to a high-visibility AI Agent Platform. You will work on core building blocks—such as the software development kit (SDK), orchestration patterns, reusable components, and quality tooling that enable teams to create conversational, voice, and document-extraction agent experiences. You will help turn complex problems into dependable production systems, raise engineering standards, and improve accuracy and reliability through disciplined evaluation and iteration.

Job Responsibilities

• Build core SDK features and reusable components that enable teams to compose and operate AI agents consistently and safely.
• Implement orchestration and tool/function-calling patterns that improve reliability, traceability, and developer experience.
• Develop retrieval and grounding capabilities that connect agents to approved data sources and reduce incorrect or unsupported responses.
• Create evaluation datasets, benchmarks, and quality metrics to measure capability accuracy and guide iterative improvements.
• Add testing, observability, and monitoring features (tracing, logs, latency and cost metrics) to improve operability and incident readiness.
• Partner with cross-functional stakeholders to translate requirements into secure, scalable, production-ready solutions.
• Contribute to documentation, examples, and reference implementations that accelerate adoption and consistent usage.
• Participate in code reviews and design discussions to improve maintainability, performance, and overall engineering standards.

Required Qualifications, Capabilities And Skills

• Formal training or certification on software engineering concepts and 2+ years applied experience
• Two or more years of hands-on Python development experience delivering production software.
• Experience building and operating backend services or platform components with attention to reliability, performance, and maintainability.
• Experience writing automated tests and using version control and code review practices to maintain quality.
• Experience integrating application components with data sources and building robust error-handling and observability practices.
• Ability to break down ambiguous problems into clear deliverables, iterate quickly, and communicate trade-offs to partners.
• Strong collaboration and communication skills, with a focus on outcomes and continuous improvement.

Preferred Qualifications, Capabilities And Skills

• Experience building with large language model (LLM) application patterns, such as retrieval‑augmented generation and prompt iteration.
• Familiarity with evaluation approaches for LLM‑enabled systems (offline evaluation, regression testing, and metric‑driven iteration).
• Exposure to voice or speech‑enabled experiences (speech‑to‑text, text‑to‑speech, or streaming interactions).
• Exposure to document processing approaches (for example, optical character recognition and structured field extraction).
• Experience with containerization and continuous integration/continuous delivery practices.
• Familiarity with cloud platforms (for example, Amazon Web Services) and modern production operations practices.

About Us

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission‑based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility.

• Base salary determined based on role, experience, skill set and location.
• Commission‑based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity.
• Comprehensive health care coverage.
• On‑site health and wellness centers.
• A retirement savings plan.
• Backup childcare.
• Tuition reimbursement.
• Mental health support.
• Financial coaching.

Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans.

About The Team

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success.