Software Engineer III - GenAI Patterns

JPMorgan Chase & Co.; Plano (TX); On-site; USD 120,000 - 160,000; Full time

Job summary

JPMorgan Chase & Co. in Plano, TX seeks a Software Engineer III to build AI-powered, enterprise-scale platforms as a full-stack engineer.

You will design knowledge libraries, retrieval pipelines, embedding-based search, and validation frameworks while collaborating with risk/compliance partners to ensure secure and reliable delivery.

The role emphasizes responsible AI use, robust testing, and scalable architectures in a high-compliance environment.

Qualifications

• 3+ years of applied software engineering experience.
• Solid full-stack fundamentals and a build-it-right mindset.
• Experience building production systems with CI/CD, monitoring, and scalability.
• Familiarity with search and retrieval systems (semantic search, vector stores).
• Hands-on experience using enterprise-authorized AI-assisted development tools with critical evaluation of AI outputs.
• Understanding of responsible AI use in engineering workflows, including data sensitivity and secure handling of inputs/outputs.
• Comfort working with LLM-based systems in real-world environments.
• Ability to collaborate with product, risk/compliance, and engineering teams.

Responsibilities

• Build and own end-to-end, full-stack features (UI, APIs, services, data layers) for AI-enabled products.
• Design and implement knowledge library + retrieval capabilities, embedding generation, indexing, and semantic search pipelines.
• Develop AI content and document-generation solutions with guardrails and auditability for regulated workflows.
• Leverage enterprise-authorized AI coding tools to improve code quality, delivery speed, and productivity with peer review and automated testing.
• Apply SDLC tooling knowledge including AI-assisted development to improve automation and value.
• Engineer agentic workflows with robust validations (policy checks, constraints, and deterministic controls).
• Implement semantic validations to improve output quality (grounding checks, relevance, duplication detection).
• Stay current on AI/ML industry trends and translate into pragmatic engineering decisions.
• Raise the bar on engineering best practices: testing, reliability, observability, performance, and secure coding patterns.

Skills

Full-stack engineering

CI/CD

Production systems

Semantic search

AI-assisted development

Secure coding

LLM-based systems

Cross-functional collaboration

Learning mindset

Education

Software engineering certification

Tools

Python

Java Spring Boot

OpenAI

Vector databases

Pinecone

AWS

Job description

As a Software Engineer III at JPMorganChase within the Commercial and Investment Bank, you serve as a full-stack software engineer who’s passionate about building AI-powered solutions that perform reliably at enterprise scale. You’ll help shape and deliver production-grade platforms that blend strong software engineering with modern GenAI patterns—retrieval, knowledge libraries, embedding-based search pipelines, and validation frameworks—while operating in a high-compliance environment.

Job Responsibilities

• Build and own end-to-end, full-stack features (UI, APIs, services, data layers) for AI-enabled products used at scale.
• Design and implement knowledge library + retrieval (RAG) capabilities, including embedding generation, indexing strategies, and semantic search pipelines.
• Develop AI content and document-generation solutions, with guardrails and auditability appropriate for regulated workflows.

• Leverages enterprise-authorized AI coding assist tools within the work environment to improve code quality, delivery speed, and productivity across complex deliverables (e.g., code generation/refactoring, unit test creation, documentation), while validating outputs through peer review, automated testing, and secure coding standards; contributes learnings and reusable patterns to improve broader team effectiveness.

• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.

• Engineer agentic workflows (tool-using/step-based systems) with robust agentic validations (policy checks, workflow constraints, and deterministic controls).
• Implement semantic validations to improve output quality (grounding checks, relevance, duplication detection, hallucination-reduction patterns, and structured evaluation signals).
• Stay current on industry trends in applied AI/ML systems and translate them into pragmatic, maintainable engineering decisions.
• Raise the bar on engineering best practices: testing strategy, reliability, observability, performance, and secure coding patterns.

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 3+ years applied experience
• Strong full-stack engineering fundamentals and a “build it right” mindset (clean APIs, robust services, thoughtful UX).
• Experience building production systems: CI/CD, monitoring/alerting, incident hygiene, performance tuning, and scalability.
• Familiarity with search and retrieval systems (semantic search, vector stores, indexing, ranking, query pipelines) and how they integrate into applications.

• Hands-on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.

• Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices.

• Comfort working with LLM-based systems (prompting patterns, structured outputs, evaluation, and guardrails) in real-world environments.
• A high learning mindset—curious, adaptable, and motivated to apply modern best practices thoughtfully rather than chasing hype.
• Ability to collaborate across engineering, product, and risk/compliance partners to deliver safely and responsibly.

Preferred qualifications, capabilities, and skills

• Knowledge of generative AI concepts., prompt engineering, RAG, embeddings, and vector search, LangChain
• Knowledge of model evaluation, guardrails, hallucination reduction
• Experience with Python, Java(spring boot),Open AI, Database(vector/pinecone), AWS
• Knowledge on open source community contribution/start up experience is plus
• Self motivation and Passion is the key driver