Lead Data Platform Engineer: AI-Powered Pipelines

Archer; Austin (TX); On-site; USD 180,000 - 240,000; Full time

Job summary

JPMorgan Chase in Austin seeks a Lead Software Engineer to join the Commercial & Investment Banking Data Analytics - Payments Technology team. You will contribute as a core technical member building trusted, scalable products in a secure environment within an agile team.

The role focuses on building data pipelines with Spark, Airflow, Kafka, and Flink; implementing AI-assisted development, ensuring production readiness and security; collaborating with analytics, product managers, and

Qualifications

• Formal training or certification on software engineering concepts and 5+ years of applied experience.
• Hands-on experience delivering system design, application development, testing, and operational stability.
• Demonstrated experience leading AI-assisted software development tools with secure code practices.

Responsibilities

• Executes creative software solutions, design, development, and technical troubleshooting with ability to think beyond routine approaches.
• Designs, builds, and maintains scalable data pipelines for batch and real-time processing using Spark, Airflow, Kafka, and Flink.
• Drives team adoption of enterprise AI-assisted engineering practices to improve code quality and delivery speed while upholding standards.
• Applies SDLC tools to improve automation and value realization.
• Design, build and manage enterprise applications at scale for robust data processing and ingestion.
• Lead the design and evolution of event-driven microservices workflows using Kafka for inter-service communication.
• Implements data modeling strategies to support analytics and reporting.
• Partners with analytics, product managers, and stakeholders to translate requirements into production-grade solutions.
• Set and uphold engineering standards for Spring Boot services and security.
• Ensure production readiness through observability, alerting, and incident response.
• Develops secure high-quality production code and reviews others' code.
• Leads exploration of new technologies and architectures with external teams.

Skills

Spark

Airflow

Kafka

Flink

Python

Java

SQL

CI/CD

AI-assisted development tools

Secure coding

Data modeling

AWS

Education

Bachelor's degree in Computer Science or related field

Tools

Spark

Airflow

Kafka

Flink

Python

Java

SQL

AWS

Glue

Redshift

Athena

EMR

Job description

JPMorgan Chase in Austin seeks a Lead Software Engineer to join the Commercial & Investment Banking Data Analytics - Payments Technology team. You will contribute as a core technical member building trusted, scalable products in a secure environment within an agile team.

The role focuses on building data pipelines with Spark, Airflow, Kafka, and Flink; implementing AI-assisted development, ensuring production readiness and security; collaborating with analytics, product managers, and