Senior Data Engineer — IDS & Knowledge Graph

BNY Mellon; Pittsburgh (Allegheny County); On-site; USD 120,000 - 170,000; Full time

Job summary

BNY Mellon is seeking a Data Engineer to join the Data Innovation team in Pittsburgh, PA or Lake Mary, FL. You will design and build scalable data pipelines powering the Investment Data Standard (IDS) and knowledge graph, enabling a unified data ecosystem for analytics, AI, and client solutions.

You will partner with Ontology/Knowledge Architecture and collaborate across platform, product, and data teams to deliver production-ready solutions aligned to the broader data transformation strategy.

Qualifications

• Bachelor's degree required or equivalent work experience.
• 8–12 years of experience, with at least 4 years in data analysis and business intelligence.
• Extensive experience in data engineering and building scalable pipelines.
• Deep expertise in Python, Spark, and SQL with ETL/ELT frameworks.
• Experience with high-volume, resilient pipelines across batch, streaming, and distributed environments.
• Knowledge of Snowflake, AWS, Databricks and modern data platforms.
• Familiarity with knowledge graph/ontology-driven systems and data lineage.

Responsibilities

• Design and build scalable pipelines to ingest and process data from internal platforms and vendors across batch, streaming, and near real-time patterns.
• Transform diverse data formats into clean, standardized time-series and event-driven datasets aligned to IDS models.
• Develop reusable frameworks to normalize identifiers, symbology, units, hierarchies, and event data.
• Map source data to canonical entities, relationships, and attributes enabling graph ingestion and entity resolution.
• Implement data quality controls with full lineage, provenance, and traceability.
• Enable multi-vendor data ingestion, comparison, and reconciliation with quality analytics.
• Build modular, cloud-native pipelines optimized for scale, performance, and cost (Snowflake, AWS) with monitoring and reliability.

Skills

Python

Spark

SQL

ETL/ELT

Data pipelines

Orchestration tools

Data quality

Entity resolution

Knowledge graph

API integration

Cloud-native pipelines

Education

Bachelor's degree

Advanced degree preferred

Tools

Snowflake

AWS

Databricks

APIs

Job description

BNY Mellon is seeking a Data Engineer to join the Data Innovation team in Pittsburgh, PA or Lake Mary, FL. You will design and build scalable data pipelines powering the Investment Data Standard (IDS) and knowledge graph, enabling a unified data ecosystem for analytics, AI, and client solutions.

You will partner with Ontology/Knowledge Architecture and collaborate across platform, product, and data teams to deliver production-ready solutions aligned to the broader data transformation strategy.