Senior PySpark Engineer (AWS/Databricks)

Next Frontier Capital; Plano (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

JPMorganChase is seeking a Software Engineer III to join Corporate Technology and help design and deliver secure, scalable technology products. You will work on critical solutions, contribute to architecture, and ensure data-driven improvements across complex data sets.

Responsibilities include building production-grade code, applying AI-assisted development tools, and upholding security and resiliency standards within an agile environment.

Qualifications

• Formal training or certification on software engineering concepts and 3+ years applied experience.
• Hands-on practical experience in system design, application development, testing, and operational stability.
• Experience in developing, debugging, and maintaining code in a large corporate environment with modern programming languages and database querying languages.
• Hands-on use of enterprise AI-assisted development tools with ability to evaluate outputs for correctness, performance and security.
• Understanding of responsible AI use in engineering workflows and data sensitivity considerations.
• Understanding of the Software Development Life Cycle and agile methodologies (CI/CD, resiliency, security).
• Experience with one or more programming languages/frameworks (Python, PySpark, Big Data, Data pipelines, ML).
• Strong SQL skills and ability to validate data quality at scale.
• Experience configuring Spark clusters and AWS services (EMR, EC2, S3, CloudWatch).
• Databricks and Data Pipelines experience.

Responsibilities

• Executes software solutions, design, development, and troubleshooting with ability to handle complex problems.
• Creates secure, high-quality production code and maintains algorithms.
• Leverages enterprise AI coding assist tools to improve code quality, delivery speed, and productivity with peer review and automated testing.
• Applies SDLC tools including AI-assisted development to improve automation.
• Produces architecture and design artifacts for complex applications and ensures constraints are met.
• Gathers and analyzes data to develop visualizations and reporting for continuous improvement.
• Identifies hidden problems in data to improve coding hygiene and system architecture.

Skills

System design

Application development

Operational stability

AI-assisted development tools

CI/CD

Security & resiliency

Python

SQL

Spark

AWS (EMR, EC2, S3, CloudWatch)

Education

Software engineering training/certification

Tools

Databricks

Airflow

Control-M

AWS services

Job description

JPMorganChase is seeking a Software Engineer III to join Corporate Technology and help design and deliver secure, scalable technology products. You will work on critical solutions, contribute to architecture, and ensure data-driven improvements across complex data sets.

Responsibilities include building production-grade code, applying AI-assisted development tools, and upholding security and resiliency standards within an agile environment.