Lead Data Engineer: Cloud Pipelines, AI Tools & Governance

JPMorganChase; Plano (TX); On-site; USD 150,000 - 190,000; Full time

Job summary

JPMorgan Chase in Plano, TX seeks a Lead Data Engineer to design, develop, and maintain robust data pipelines and architectures across data lake and data warehouse environments. You will mentor engineers, drive data governance, optimize performance, and collaborate with business analytics and technology partners while ensuring secure, scalable data solutions in cloud platforms such as AWS and Snowflake.

With 5+ years of data engineering experience, you will tackle large-scale processing,

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 5+ years of experience in data engineering with deep AWS, Data Lake, and Snowflake expertise.
• Hands-on experience with modern data lake and warehousing technologies (e.g., Redshift, BigQuery, Snowflake; and engines such as Spark, Flink, or Trino).
• Apply Agile methodologies, running ceremonies and prioritizing backlogs for continuous improvement.
• Exhibit proficiency in SQL and experience with data pipeline/ETL tools.
• Demonstrated experience using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.
• Ability to review and validate AI-assisted outputs (e.g., query suggestions, test ideas, or model change summaries) before use, escalating when uncertain and following data handling requirements.
• Experience designing and building streaming pipelines using Kafka, Pub/Sub, or similar messaging systems.
• Experience with large-scale distributed data processing and performance tuning.
• Design and implement large-scale data solutions in cloud environments.

Responsibilities

• Design, build, maintain and optimize scalable batch and streaming data pipelines with strong performance, fault tolerance, and observability.
• Develop and operate workflow orchestration to schedule, monitor, and manage data movement and transformations.
• Translate complex business requirements into technical solutions meeting data lake and data warehousing standards.
• Use enterprise-authorized AI capabilities within the work environment to accelerate data pipeline/design analysis and documentation, validating outputs and handling data according to sensitivity and security requirements.
• Apply reuse-first, AI‑assisted practices to strengthen SDLC-quality routines for data pipelines (e.g., test generation and control validation), ensuring traceability/auditability and alignment to resiliency and security expectations.
• Build and maintain governance processes for data modeling, cataloging, ownership, and access control.
• Provide mentorship and training on data publication best practices to team members and lead the team's technical direction through standards, reviews, and knowledge sharing.
• Stay up‑to‑date with advancements in AWS Data Lake, Snowflake Data Warehouse and related technologies.
• Perform advanced quantitative analysis of large datasets to identify business trends.
• Manage data sharing, exchange, and ecosystem‑specific features.

Skills

Leadership

Mentoring

Communication

Analysis

Regulatory awareness

Education

Bachelor's degree in Computer Science, Information Technology, or related field

Tools

Redshift

BigQuery

Snowflake

Spark

Flink

Trino

Kafka

Pub/Sub

SQL

Airflow

Job description

JPMorgan Chase in Plano, TX seeks a Lead Data Engineer to design, develop, and maintain robust data pipelines and architectures across data lake and data warehouse environments. You will mentor engineers, drive data governance, optimize performance, and collaborate with business analytics and technology partners while ensuring secure, scalable data solutions in cloud platforms such as AWS and Snowflake.

With 5+ years of data engineering experience, you will tackle large-scale processing,