Senior Data Engineer

001 Manufacturers and Traders Trust Co; Buffalo (NY); On-site; USD 97,000 - 162,000; Full time

Job summary

M&T Bank Corporation in Buffalo, NY is seeking a data engineer to design, develop, test, deploy and support complex data pipelines and data products across cloud, warehouse and lakehouse platforms.

You will use SQL and Python, implement with Snowflake, Databricks and dbt, and collaborate with product, governance and cybersecurity teams to deliver reliable, scalable data solutions.

Qualifications

• Strong SQL skills with complex transformations and analytical queries.
• Experience with Python for data engineering.
• Hands-on experience with Snowflake, Databricks or comparable cloud data platform.
• Experience with ELT/ETL and dbt or comparable framework.
• Experience with relational data stores and warehouse or lakehouse data-modeling concepts.
• Experience with distributed processing using Spark/PySpark or comparable framework.
• Experience with Git-based source control, automated testing and CI/CD fundamentals.
• Experience with batch data processing and knowledge of streaming/event-driven concepts.
• Knowledge of cloud/object storage concepts, preferably Microsoft Azure.
• Experience with structured and semi-structured data formats such as Parquet/JSON/CSV/Avro/XML.
• Experience with Linux/Unix environments and scripting.
• Demonstrated ability to deliver complex data pipeline components independently.

Responsibilities

• Design, develop, test, deploy and support complex production data pipelines and data products.
• Develop maintainable data-processing solutions using SQL and Python.
• Implement solutions using Snowflake, Databricks, dbt and comparable platforms.
• Build data solutions across relational databases, cloud storage, warehouse and lakehouse architectures.
• Develop batch, micro-batch, CDC and streaming pipelines with enterprise patterns.
• Participate in production support, incident resolution and root-cause analysis.
• Use Git, peer reviews, automated testing, CI/CD and environment promotion practices.

Skills

SQL

Python

Git

CI/CD

Data modeling

Spark/PySpark

Databricks

Snowflake

ETL/ELT

Airflow

Education

Associate’s degree

Bachelor’s degree

Tools

Snowflake

Databricks

dbt

Apache Iceberg

Apache Kafka

Airflow

Azure Data Factory

Terraform

Open table formats

Job description

Job Description Overview

Designs, develops, tests, deploys and supports complex data pipelines, data products and data management solutions across modern cloud, warehouse and lakehouse platforms. Applies software-engineering, data-modeling and distributed-processing practices to deliver secure, reliable, maintainable and cost-conscious solutions. Works independently on defined outcomes, collaborates across technology and data teams, and contributes to reusable engineering patterns and continuous improvement.

Primary Responsibilities

Design, develop, test, deploy and support complex production data pipelines and data products with guidance on broader architecture where needed. Develop maintainable data-processing and transformation solutions using SQL and programming languages such as Python. Implement solutions using Snowflake, Databricks, dbt and comparable modern data platforms and frameworks. Build data solutions across relational databases, cloud object storage, warehouse and lakehouse architectures, including open table formats such as Apache Iceberg where applicable. Develop batch, micro-batch, CDC and streaming pipelines using approved enterprise patterns and technologies such as Apache Kafka or comparable platforms. Integrate data from relational and mainframe systems, APIs, event streams, SaaS platforms, files and object storage. Apply normalized, dimensional and denormalized data-modeling techniques appropriate to analytical and data-product requirements. Tune SQL, Snowflake and Databricks/Spark workloads for performance and cost using appropriate partitioning, parallelism and compute practices. Implement data quality, reconciliation, metadata, lineage, logging, monitoring and alerting controls. Build pipelines that support error handling, restartability, idempotency, retry, replay and recovery using established patterns. Participate in production support, incident resolution and root-cause analysis; implement corrective actions to prevent recurrence. Use Git, peer review, automated testing, CI/CD and environment promotion practices for data engineering delivery. Develop and reuse shared components, templates and patterns; contribute improvements to engineering standards and documentation. Participate in technical design and code reviews, identify implementation risks and elevate architectural concerns appropriately. Partner with product owners, architects, governance, cybersecurity, platform and consuming teams to clarify requirements and deliver supported solutions. Contribute to technical epics and stories, estimate assigned work, identify dependencies and deliver through Agile practices. Provide day-to-day technical assistance and informal mentoring to less-experienced engineers. This role does not have direct people-management responsibility. Understand and adhere to the Company’s risk and regulatory standards, policies and controls in accordance with the Company’s Risk Appetite. Design, implement, maintain and enhance internal controls to mitigate risk on an ongoing basis. Identify risk-related issues requiring escalation to management. Maintain internal control standards, including timely implementation of internal and external audit points and issues raised by external regulators, as applicable. Promote an environment that supports belonging and reflects the Company brand. Complete other related duties as assigned.

Education and Experience Required

• Associate’s degree and a minimum of 5 years’ systems analysis and/ or application development work experience or Bachelor's degree and a minimum of 3 years’ systems analysis and/ or application development work experience
• In lieu of degree, a combined minimum of 7 years’ education and/or relevant work experience, including a minimum of 3 years’ systems analysis and/or application development work experience
• Strong SQL skills, including development of complex transformations and analytical queries
• Experience with Python or another general-purpose programming language used for data engineering
• Hands-on experience with Snowflake, Databricks or a comparable cloud data platform
• Experience with ELT/ETL and transformation practices, including dbt or a comparable framework
• Experience with relational data stores and warehouse or lakehouse data-modeling concepts
• Experience with distributed processing using Apache Spark/PySpark or a comparable framework
• Experience with Git-based source control, automated testing and CI/CD fundamentals
• Experience with batch data processing and working knowledge of streaming or event-driven concepts
• Knowledge of cloud and object-storage concepts, preferably in Microsoft Azure
• Experience working with structured and semi-structured data using formats such as Parquet, JSON, CSV, Avro and XML
• Experience with Linux/Unix environments and scripting
• Demonstrated ability to independently deliver complex data pipeline components and data products within an established architecture
• Demonstrated ability to troubleshoot data-processing, data-quality and production issues across multiple technologies
• Demonstrated ability to apply established engineering patterns while identifying opportunities for improvement
• Demonstrated ability to communicate implementation choices, risks and dependencies to technical and product partners
• Demonstrated ability to manage assigned work from design through production support with limited day-to-day supervision

Education and Experience Preferred

• Production experience with Snowflake, Databricks, Apache Spark/PySpark and dbt
• Experience with Apache Iceberg or another open table format
• Experience with Apache Kafka, CDC or event-driven data processing
• Experience with orchestration technologies such as Apache Airflow, Azure Data Factory, Databricks Workflows or dbt orchestration
• Experience with Terraform or another Infrastructure as Code technology
• Experience with data catalogs, metadata, lineage, observability or automated data-quality tooling
• Experience delivering governed enterprise data products
• Experience working in a regulated environment such as financial services

Compensation

M&T Bank is committed to fair, competitive, and market-informed pay for our employees. The pay range for this position is $97,100.00 - $161,800.00 Annual (USD). The successful candidate’s particular combination of knowledge, skills, and experience will inform their specific compensation.

Location

Location Buffalo, New York, United States of America

About M&T Bank

Great companies have an enduring sense of purpose. At M&T, our purpose is a simple one: make a difference in people’s lives and uplift the communities we serve. M&T Bank Corporation is a financial holding company headquartered in Buffalo, New York. M&T’s affiliates offer advice, guidance, expertise and solutions across the entire financial spectrum, combining M&T Bank’s traditional banking services with the wealth management and institutional capabilities offered by Wilmington Trust. M&T Bank has a network of over 1,000 branches and 2,200 ATMs that span 12 states from Maine to Virginia and Washington, D.C. For more than 165 years, M&T has strived to take an active role in our communities and build long‑lasting relationships with our customers. We are a bank for communities—combining the capabilities of a large bank with the care of a locally focused institution. As an employer of choice, we are proud to offer competitive benefits ranging from medical and retirement to forty hours of paid volunteer time, each year. Our core values – integrity, ownership, collaboration, curiosity, and candor – drive the work we do. We seek to further build upon our record of success by bringing in top talent and fresh skill sets while continuing to support the growth and development of all our team members. View M&T’s Human Capital Report to learn more.

Equal Employment Opportunity

M&T Bank is unwavering when it comes to providing equal employment opportunities to all employees and applicants without regard to race, color, national origin, religion, ethnicity, sex, gender identity, age, disability, citizenship, pregnancy, veteran status, military status, marital status, sexual orientation, genetic information or any other characteristic protected under applicable federal, state or local laws. M&T Bank Corporation has policies and procedures in place to promote a drug free workplace.