Lead Real-Time Data Streaming Engineer (Flink, Kafka)

Bank of America; Jersey City (NJ); On-site; USD 140,000 - 200,000; Full time

Job summary

Bank of America in the United States seeks a Senior Data Streaming Engineer to design and deliver real-time data platforms that support ITSM and infrastructure. You will build scalable streaming pipelines with Flink and Confluent Kafka, modernizing legacy systems into streaming-first architecture.

You will mentor junior engineers, collaborate with product and platform teams, and ensure data quality and performance.

Qualifications

• 10+ years IT experience focused on data engineering.
• 5+ years in data warehousing, data lakes, or MDM systems.
• Experience with Apache Flink, Confluent Kafka, and Apache Iceberg.
• Proficiency with Python, PySpark, or Java/Scala for data engineering.
• SQL proficiency with advanced querying and optimization.

Responsibilities

• Leads story refinement and delivery of requirements through the delivery lifecycle.
• Codes complex solutions to integrate, clean, transform, and control data.
• Leads documentation of system requirements and feasibility assessments.
• Leads testing teams to develop test plans and analyze results.
• Leads collaboration with partners to enforce data management standards.
• Defines and builds data pipelines to enable data-informed decisions.
• Mentors Data Engineers and monitors KPIs and controls.
• Designs and implements real-time data pipelines using Flink and Kafka.
• Transforms legacy batch workflows into streaming architectures.
• Builds streaming ingestion, transformation, and enrichment pipelines.
• Develops Iceberg-based lakehouse tables for streaming and analytics.
• Ensures data quality, reconciliation, and consistency across systems.
• Optimizes performance, state management, and checkpointing of streaming jobs.
• Collaborates on partitioning, schema evolution, and storage strategies.

Skills

Apache Flink

Confluent Kafka

Apache Iceberg

Python/PySpark/Java/Scala

SQL

Streaming architectures

Data modeling

CI/CD

DevOps practices

Jira/Bitbucket

Tools

Kafka Connect

ksqlDB

Iceberg tooling

Parquet

Avro

Job description

Bank of America in the United States seeks a Senior Data Streaming Engineer to design and deliver real-time data platforms that support ITSM and infrastructure. You will build scalable streaming pipelines with Flink and Confluent Kafka, modernizing legacy systems into streaming-first architecture.

You will mentor junior engineers, collaborate with product and platform teams, and ensure data quality and performance.