Senior Data Engineering Lead - Cloud ETL & Spark

Next Frontier Capital; Columbus (OH); On-site; USD 140,000 - 210,000; Full time

Job summary

JPMorgan Chase's Consumer & Community Banking/Data Products team seeks a Lead Software Engineer – Data Engineering to shape trusted data products in a secure, scalable way. You will lead design and delivery of data solutions across multiple business areas, collaborating with cross-functional teams.

You will build large-scale ETL pipelines, Python apps, and PySpark jobs, manage data lakes with Iceberg/Delta Lake, and administer Snowflake environments while enforcing testing, CI/CD, and enterprise

Responsibilities

• Design, develop, and optimize large-scale ETL data pipelines.
• Build high-quality Python applications with modular code, logging, and tests.
• Develop and maintain distributed data processing with PySpark.
• Design end-to-end testing and validation.
• Implement workflow orchestration with Control-M or Apache Airflow (MWAA).
• Develop cloud-native solutions on AWS (Glue, Athena, Lambda, CloudWatch).
• Design data lake architectures using Iceberg/Delta Lake.
• Administer Snowflake environments (streams, tasks, roles, warehouses).
• Participate in code reviews and promote best practices, testing standards, CI/CD.

Job description

JPMorgan Chase's Consumer & Community Banking/Data Products team seeks a Lead Software Engineer – Data Engineering to shape trusted data products in a secure, scalable way. You will lead design and delivery of data solutions across multiple business areas, collaborating with cross-functional teams.

You will build large-scale ETL pipelines, Python apps, and PySpark jobs, manage data lakes with Iceberg/Delta Lake, and administer Snowflake environments while enforcing testing, CI/CD, and enterprise