Senior Lead Software Engineer - Python, PySpark, Big Data, Data pipeline, ML/AI

Next Frontier Capital; Plano (TX); On-site; USD 150,000 - 210,000; Full time

Job summary

JPMorgan Chase & Co. is seeking a Senior Lead Software Engineer to drive design, development, and governance of AI-assisted engineering within the Risk Technology Portfolio. You will lead cross-team initiatives, ensure secure, scalable production code, and advance ML delivery practices across multiple technologies.

The role emphasizes hands-on system design, data-driven improvements, and collaboration within an agile environment to deliver trusted financial technology products.

Qualifications

• Formal training and 5+ years of applied software engineering experience.
• 2+ years of experience leading technologists to manage and solve complex technical items.
• Experience in system design, development, testing, and operational stability.
• Experience with enterprise AI-assisted development tools and evaluating AI outputs for correctness, performance, and security.
• Strong understanding of CI/CD, Application Resiliency, and Security.

Responsibilities

• Execute software design, development, and troubleshooting with innovative problem-solving.
• Lead AI-assisted engineering practices to improve quality, speed, and reliability; establish validation standards.
• Leverage SDLC tools and AI-assisted development to drive efficiency and reuse of firm assets.
• Produce secure, high-quality production code and maintain scaling architectures.
• Advance AI/ML delivery best practices alongside software engineering standards.
• Define architecture for multiple complex deliverables and ensure alignment with business goals.
• Glean insights from large data sets to improve software applications and systems.
• Identify hidden data patterns to improve coding hygiene and system design.

Skills

AI-assisted development

CI/CD

Spark

Databricks

Python

SQL

Big Data

Security

Machine Learning

AWS

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Databricks

AWS

Airflow

Job description

Be an integral part of an agile team that's constantly pushing the envelope to enhance, build, and deliver top-notch technology products.

As a Senior Lead Software Engineer at JPMorgan Chase within the Consumer and Community Banking - Risk Technology Portfolio team, you are an integral part of an agile team that works to enhance, build, and deliver trusted market-leading technology products in a secure, stable, and scalable way. Drive significant business impact through your capabilities and contributions, and apply deep technical expertise and problem-solving methodologies to tackle a diverse array of challenges that span multiple technologies and applications.

Job responsibilities:

• Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or breakdown technical problems
• Drives adoption and governance of approved AI-assisted engineering practices across teams to improve code quality, delivery speed, and operational outcomes (e.g., AI-assisted code review/refactoring, test acceleration, release readiness, incident/root-cause analysis), while establishing measurable validation standards (secure coding, peer review, automated testing) and promoting reuse of proven patterns and automation within the SDLC/TLM toolchain.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to drive efficiency and support capacity unlock initiatives across teams, prioritizing reuse of existing firm technology assets.
• Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems
• Drive the AI / ML delivery best practices along with software engineering best practices.
• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.
• Define architecture for series of complex deliverables.
• Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems
• Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture

Required qualifications, capabilities, and skills:

• Formal training and certification on software engineering concepts and 5+ years applied experience. In addition, 2+ years of experience leading technologists to manage and solve complex technical items within your domain of expertise
• Hands-on practical experience in system design, application development, testing, and operational stability
• Experience in developing, debugging, and maintaining code in a large corporate environment with one or more modern programming languages and database querying languages
• Hands‑on experience using enterprise-authorized AI-assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI-generated outputs for correctness, performance, and security.
• Solid understanding of agile methodologies such as CI/CD, Application Resiliency, and Security
• Good knowledge of Machine Learning modelling as an engineer
• Experience in working with one or more programming language(s) and framework(s) (i.e., Python, PySpark, Big Data, Data pipeline, Machine Learning, etc.)
• Strong SQL skills with ability to validate features and data quality at scale
• Experience configuring and optimizing Spark clusters for processing large data.
• Hands-on experience working with AWS services including EMR, EC2, S3, and CloudWatch
• Working knowledge on Databricks in creating Data Pipelines, Machine learning models deployment.

Preferred qualifications, skills, and capabilities:

• Expertise with programming languages like Java, python
• Experience in Cloud Technologies (i.e., AWS - Databricks preferred)
• Experience with serving high volume, High availability & ultra low latency API solutions with Java - Spring Boot applications
• Awareness with Python Machine Learning libraries and ecosystems (i.e., Pandas, Numpy, etc.)
• AWS certifications (e.g. Solutions Architect Associate)
• Exposure to workflow orchestration tools (e.g. Apache Airflow)
• Familiarity with modern LLM techniques

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

Our Corporate Technology team relies on smart, driven people like you to develop applications and provide tech support for all our corporate functions across our network. Your efforts will touch lives all over the financial spectrum and across all our divisions: Global Finance, Corporate Treasury, Risk Management, Human Resources, Compliance, Legal, and within the Corporate Administrative Office. You’ll be part of a team specifically built to meet and exceed our evolving technology needs, as well as our technology controls agenda. Drive significant business impact and tackle a diverse array of challenges that span multiple technologies and applications