Senior Data Engineer - Real-Time Data Platforms Lead

Bank of America Corporation; New Brunswick; Vor Ort; CAD 90.000 - 130.000; Vollzeit

Zusammenfassung

Bank of America in Canada seeks a senior data engineer to drive enterprise-scale data platforms, leveraging Spark/Scala, Kafka, Hadoop, Starburst, and cloud technologies. You will lead design reviews, mentor development teams, and deliver robust data integration across real-time, near real-time, and batch processing environments.

The role requires 10+ years in data delivery/integration, strong knowledge of Hadoop and Starburst, and hands-on experience with streaming and batch data pipelines.

Qualifikationen

• 10+ years of experience with Data Engineering.
• Experience with large-scale analytical platforms, metadata-driven architectures, and distributed data processing.
• Design and implement cloud-native data platforms utilizing Object Storage, Data Lakehouse architectures, distributed query engines, and streaming tech.
• Hands-on experience in Scala, Spark, Kafka Streaming.
• Knowledge of Hadoop components and related tools.
• Experience with real-time, near real-time, and batch data integration solutions.
• Experience with UNIX scripting and scheduling tools.

Aufgaben

• Assembles large, complex data sets meeting functional and non-functional requirements across multiple systems.
• Maintains, cleans, and manipulates large data for operational and analytics data systems.
• Defines and builds data pipelines to enable data-informed decision making.
• Contributes to test suites and leads triage of issues.
• Mentors Data Engineers in CI/CD and data delivery practices.

Kenntnisse

Data engineering

Cloud data platforms

Scala

Spark

Kafka

Hadoop

SQL tuning

UNIX scripting

Tools

Informatica

Starburst

Object Storage

Exadata

Oracle SQL

Jobbeschreibung

Bank of America in Canada seeks a senior data engineer to drive enterprise-scale data platforms, leveraging Spark/Scala, Kafka, Hadoop, Starburst, and cloud technologies. You will lead design reviews, mentor development teams, and deliver robust data integration across real-time, near real-time, and batch processing environments.

The role requires 10+ years in data delivery/integration, strong knowledge of Hadoop and Starburst, and hands-on experience with streaming and batch data pipelines.