Software Engineer III - Data Engineer

Next Frontier Capital; Plano (TX); On-site; USD 140,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Retirement plan

Tuition reimbursement

Job summary

JPMorgan Chase & Co. is seeking a Senior Associate Data Engineer to help design and modernize the risk feature engineering platform within Corporate Technology Risk. You will build scalable batch and streaming pipelines, apply governance controls, and collaborate with data scientists and engineers.

You will migrate legacy workloads to Databricks-native architectures, implement CI/CD, automate testing, and leverage enterprise AI-assisted tools to boost productivity and quality.

Qualifications

• Formal training or certification in software engineering, computer science, data engineering, or related discipline with 3+ years of applied industry experience.
• Hands-on experience with Databricks, Apache Spark, PySpark, Delta Lake, and modern Lakehouse architectures.
• Experience building and supporting large-scale batch and streaming data pipelines.
• Proficiency in Python and SQL with a strong understanding of distributed computing principles.
• Hands-on experience using enterprise-authorized AI-assisted software development tools with evaluation of AI outputs for correctness, performance, and security.
• Understanding of responsible AI use in engineering workflows and secure handling of data.
• Working knowledge of Databricks Unity Catalog, Delta Live Tables, and modern declarative pipeline frameworks.
• Experience with AWS services including S3, Glue, EMR, Lambda, ECS/EKS.

Responsibilities

• Design, develop, and support scalable feature engineering solutions on Databricks for risk analytics and ML.
• Build and maintain reusable batch and real-time feature pipelines with onboarding, versioning, and monitoring.
• Implement data engineering solutions using Databricks, Spark, PySpark, Delta Lake, Lakeflow; ensure scalability and maintainability.
• Drive platform modernization by migrating legacy Spark/EMR workloads to Databricks-native architectures.
• Apply software engineering best practices including CI/CD, testing, reviews, observability, and production support.
• Leverage AI-assisted tooling to accelerate development and automate SDLC activities.
• Apply data quality, governance, lineage, and security controls in regulatory contexts (PCI, etc.).
• Develop cloud-native solutions on AWS (S3, Glue, Lambda, ECS/EKS, Aurora/RDS) and IaC (Terraform).
• Participate in architecture reviews and decision-making to improve performance, stability, and cost efficiency.
• Collaborate with data scientists and engineers; mentor juniors and promote reuse-first practices.

Skills

Databricks

Apache Spark

PySpark

Delta Lake

Lakehouse architectures

Python

SQL

AWS

CI/CD

AI-assisted tools

Education

Bachelor's degree in CS/Engineering

Tools

Terraform

GitHub Copilot

Unity Catalog

Delta Live Tables

Airflow

Job description

As a Senior Associate Data Engineer within the Corporate Technology Risk organization, you will contribute to the development and modernization of the Consumer and Community Banking Risk Feature Engineering Platform. You will be expected to apply strong software engineering and data engineering practices while contributing to the platform's strategic direction through technical execution, innovation, automation, and continuous improvement.

Job Responsibilities

• Design, develop, and support scalable feature engineering solutions on Databricks that enable risk analytics, fraud detection, machine learning, and enterprise data products.
• Build and maintain reusable batch and real-time feature pipelines, including feature onboarding, versioning, testing, monitoring, and lifecycle management within the Risk Feature Store ecosystem.
• Implement modern data engineering solutions using Databricks, Apache Spark, PySpark, Delta Lake, Lakeflow, and declarative pipeline patterns, ensuring scalability, resiliency, and maintainability.
• Drive platform modernization initiatives by migrating legacy Spark and EMR workloads to Databricks-native architectures and adopting cloud-native engineering practices.
• Apply software engineering best practices including CI/CD, automated testing, code reviews, observability, release management, and production support to deliver high-quality, reliable solutions.
• Leverage enterprise-approved AI-assisted engineering tools such as GitHub Copilot and LLM Suite to accelerate development, improve code quality, automate SDLC activities, and identify opportunities for innovation.

• Applies knowledge of tools within the Software Development Life Cycle toolchain, including enterprise-authorized AI-assisted development and automation capabilities, to improve the value realized by automation.

• Implement data quality, governance, lineage, and security controls, ensuring compliance with regulatory requirements, PCI standards, metadata management, retention policies, and audit expectations.
• Develop and support cloud-native solutions on AWS, utilizing services such as S3, Glue, Lambda, ECS/EKS, Aurora/RDS, and Infrastructure-as-Code technologies including Terraform.
• Participate in architecture reviews and technical decision-making, contributing recommendations that improve platform performance, operational stability, cost efficiency, resiliency, and long-term scalability.
• Collaborate with data scientists, model developers, business stakeholders, and engineering teams, while mentoring junior engineers and promoting reuse-first, secure, and high-performing engineering practices across the organization.

Required Qualifications, Capabilities and Skills

• Formal training or certification in software engineering, computer science, data engineering, or a related discipline with 3+ years of applied industry experience.
• Strong hands‑on experience with Databricks, Apache Spark, PySpark, Delta Lake, and modern Lakehouse architectures.
• Experience building and supporting large‑scale batch and streaming data pipelines.
• Proficiency in Python and SQL with a strong understanding of distributed computing principles.

• Hands‑on experience using enterprise‑authorized AI‑assisted software development tools within the work environment (e.g., for coding, test creation, troubleshooting, or documentation) with demonstrated ability to critically evaluate, validate, and refine AI‑generated outputs for correctness, performance, and security.

• Understanding of responsible AI use in engineering workflows, including data sensitivity considerations, secure handling of inputs/outputs, and adherence to resiliency and security expectations; ability to guide peers on safe and effective usage within team practices.

• Working knowledge of Databricks Unity Catalog, Delta Live Tables, and modern declarative pipeline frameworks.
• Experience with AWS cloud services including S3, Glue, EMR, Lambda, ECS/EKS, and related technologies.
• Experience implementing data‑quality, data‑governance, and lineage solutions.
• Familiarity with data security controls, encryption, and PCI data handling requirements.

Preferred Qualifications, Capabilities and Skills

• Professional certifications such as Databricks Data Engineer Associate/Professional and/or AWS Solutions Architect/Developer certifications are strongly preferred.
• Experience with Feature Engineering platforms including Databricks Feature Engineering, Feature Store, Feature Views, or similar enterprise feature management technologies.
• Hands‑on experience building scalable real‑time and event‑driven data solutions, leveraging technologies such as Kafka, streaming frameworks, and distributed services architectures.
• Proven experience modernizing data platforms, including migration of legacy Spark/EMR workloads to Databricks-native architectures and adoption of Lakehouse best practices.
• Knowledge of cloud-native data platform technologies and governance, including Terraform, Snowflake, Databricks SQL, Unity Catalog, and Infrastructure-as-Code practices.

JPMorganChase, one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world’s most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.

We offer a competitive total rewards package including base salary determined based on the role, experience, skill set and location. Those in eligible roles may receive commission-based pay and/or discretionary incentive compensation, paid in the form of cash and/or forfeitable equity, awarded in recognition of individual achievements and contributions. We also offer a range of benefits and programs to meet employee needs, based on eligibility. These benefits include comprehensive health care coverage, on-site health and wellness centers, a retirement savings plan, backup childcare, tuition reimbursement, mental health support, financial coaching and more. Additional details about total compensation and benefits will be provided during the hiring process.

We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants’ and employees’ religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.

JPMorgan Chase & Co. is an Equal Opportunity Employer, including Disability/Veterans

Our professionals in our Corporate Functions cover a diverse range of areas from finance and risk to human resources and marketing. Our corporate teams are an essential part of our company, ensuring that we’re setting our businesses, clients, customers and employees up for success. We have an exciting and rewarding opportunity for you to take your software engineering career to the next level.