Data Engineer II: Build Scalable Pipelines & Governance

TD; Mount Laurel Township (NJ); On-site; USD 79,000 - 128,000; Full time

Job summary

TD in Mount Laurel, New Jersey, is seeking a Data Engineer II to design, model, and optimize data pipelines. You will perform data analysis, ensure data quality, and manage ingestion and metadata across platforms.

You will collaborate with cross-functional teams to implement scalable ETL processes, maintain complex data models, and uphold data governance standards while delivering reliable data solutions.

Qualifications

• Degree, Postgraduate Degree, or Technical Certificate in Data Management or related discipline (e.g. Computer Science, Engineering), or equivalent practical experience.
• 3+ years of relevant experience.

Responsibilities

• Performs data analysis and assesses data management requirements for a specific Platform or Journey, including complex analysis involving multiple pods or products.
• Maintains expert knowledge of upstream data, including knowledge provided through data profiling, data quality reporting, and via the production of metadata.
• Supports the acquisition and ingestion of data.
• Articulates complex, large scale, and high impact technical design and development details to non-technical business partners.
• Elicits, analyzes, and understands business and data requirements to develop complete business solutions, including data models (entity relationship diagrams, dimensional data models), ETL and business rules, data life-cycle management, governance, lineage, and metadata.
• Ensures data is maintained in compliance with enterprise data standards, policies, and guidelines.
• Develops and maintains complex data models using industry standard modeling tools.
• Develops and maintains complex ETL jobs and frameworks using the Bank’s standard tools.
• Provides support to the development and testing teams to resolve data issues, including escalation support on complex issues.
• Supports partners and stakeholders in interpreting and analyzing data.
• Builds effective working relationships within own pod and across partner teams to encourage collaboration on all pod deliverables.

Skills

Azure Databricks

PySpark

SQL

Azure Data Factory

Big Data, ETL, and Data Engineering

GitHub or Bitbucket

Analytical and problem-solving skills

Education

Degree or Technical Certificate in Data Management or related discipline

Tools

Delta Lake

Unity Catalog

CI/CD and DevOps practices

Data governance and lineage

Cloud migration and modernization

Job description

TD in Mount Laurel, New Jersey, is seeking a Data Engineer II to design, model, and optimize data pipelines. You will perform data analysis, ensure data quality, and manage ingestion and metadata across platforms.

You will collaborate with cross-functional teams to implement scalable ETL processes, maintain complex data models, and uphold data governance standards while delivering reliable data solutions.