Senior AI Data Engineer - Pipelines, Lakehouse & Governance

BNY; Jersey City (NJ); Sur place; USD 126 000 - 210 000; Plein temps

Avantages offerts par ce poste

Generous paid leaves

Volunteer time off

Wellbeing programs

Résumé du poste

BNY is seeking a senior Data Engineer in Jersey City to design, build, and optimize batch and streaming data pipelines that feed AI and analytics platforms. You will implement data modeling, lineage, metadata, and data quality controls to create trusted data assets and will lead orchestration across cloud and lakehouse environments.

You will collaborate with analytics, AI, business, and technology teams, mentor engineers, and promote best practices for distributed processing, testing,

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field or equivalent experience.
• 9–11 years of experience in software development and data engineering; financial services experience is a plus.
• Strong experience building large-scale batch and streaming data pipelines and backend data environments.
• Deep expertise in Spark/Databricks, Kafka, SQL, and orchestration tools such as Airflow and/or dbt.
• Strong understanding of cloud and lakehouse architectures, distributed processing, and storage formats such as Parquet and Delta.
• Experience with data modeling, schema design, lineage, metadata, and data quality frameworks.
• Proven ability to improve performance, scalability, reliability, cost efficiency, and governance across data platforms.
• Strong stakeholder management, problem-solving, and technical leadership skills.

Responsabilités

• Design, build, and optimize batch and streaming data pipelines that deliver high-quality, governed data to AI, analytics, and enterprise platforms.
• Develop scalable transformation frameworks across cloud and lakehouse environments with a focus on reliability and cost efficiency.
• Implement data modeling, schema design, lineage, metadata, and data quality controls to create trusted data assets.
• Build and support orchestration and workflow automation for complex pipelines and dependencies using modern data engineering tools.
• Partner with analytics, AI, business, and technology teams to translate requirements into scalable data solutions.
• Resolve platform and pipeline issues related to performance and data quality; promote engineering best practices.

Connaissances

Data engineering

Data governance

Cloud architectures

Leadership

Formation

Bachelor's degree or equivalent

Outils

Spark/Databricks

Kafka

Airflow

dbt

SQL

Description du poste

BNY is seeking a senior Data Engineer in Jersey City to design, build, and optimize batch and streaming data pipelines that feed AI and analytics platforms. You will implement data modeling, lineage, metadata, and data quality controls to create trusted data assets and will lead orchestration across cloud and lakehouse environments.

You will collaborate with analytics, AI, business, and technology teams, mentor engineers, and promote best practices for distributed processing, testing,