Senior Real-Time Data Streaming Engineer

Hobbsnews; Plano (TX); On-site; USD 104,000 - 158,000; Full time

Job summary

Bank of America is seeking a Senior Data Streaming Engineer to design and deliver modern, real-time data pipelines leveraging Apache Flink and Confluent Kafka. This role focuses on transforming legacy batch workflows into streaming architectures while ensuring data quality and low latency across enterprise systems.

You will lead data integration patterns, collaborate with ITSM and analytics teams, mentor engineers, and drive scalable streaming solutions aligned with enterprise data standards.

Qualifications

• 10+ years of IT experience with data engineering focus.
• 5+ years in data warehousing, data lakes, or MDM systems.
• Experience with Apache Flink, Confluent Kafka, and Apache Iceberg.

Responsibilities

• Leads story refinement and delivery of requirements through the delivery lifecycle.
• Codes complex solutions to integrate, clean, transform, and control data, builds processes supporting data transformation, data structures, metadata, data quality controls, dependency, and workload management, assembles complex data sets, and communicates required information for deployment.
• Leads documentation of system requirements, collaborates with development teams to understand data requirements and feasibility, and leverages architectural components to develop client requirements.
• Leads testing teams to develop test plans, contributes to existing test suites including integration, regression, and performance, analyzes test reports, identifies test issues and errors, and leads triage of underlying causes.
• Leads work efforts with technology partners and stakeholders to close gaps in data management standards adherence, negotiates paths forward by thinking outside the box to identify and communicate solutions to complex problems, and leverages knowledge of information systems, techniques, and processes.
• Leads complex information technology projects to ensure on‑time delivery and adherence to release processes and risk management and defines and builds data pipelines to enable data‑informed decision making.
• Mentors Data Engineers to enable continuous development and monitors key performance indicators and internal controls.
• Design and implement real‑time data pipelines using Apache Flink and Confluent Kafka
• Transform legacy batch and RDBMS‑based data workflows into event‑driven streaming architectures
• Build and optimize streaming ingestion, transformation, and enrichment pipelines
• Develop and maintain Iceberg‑based data lakehouse tables to support both streaming and analytical workloads
• Ensure data quality, reconciliation, and consistency across streaming and batch systems
• Optimize performance of streaming jobs, including state management, checkpointing, and scalability
• Design efficient partitioning, schema evolution, and storage strategies using Iceberg
• Integrate data across multiple systems including ITSM platforms (e.g., ServiceNow)
• Collaborate with architecture and platform teams to establish best practices for streaming data frameworks
• Support CI/CD, deployment, and operational monitoring of streaming pipelines

Skills

Apache Flink

Confluent Kafka

Apache Iceberg

Python

PySpark

Java/Scala

SQL

Event-driven architecture

Data modeling

Kafka ingestion

Job description

Bank of America is seeking a Senior Data Streaming Engineer to design and deliver modern, real-time data pipelines leveraging Apache Flink and Confluent Kafka. This role focuses on transforming legacy batch workflows into streaming architectures while ensuring data quality and low latency across enterprise systems.

You will lead data integration patterns, collaborate with ITSM and analytics teams, mentor engineers, and drive scalable streaming solutions aligned with enterprise data standards.