Data Engineering Manager: Lead Scalable Data Pipelines

Delaware North; Buffalo (NY); On-site; USD 101,000 - 136,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

401(k) with company match

Annual performance bonus

Paid vacation and holidays

Paid parental bonding leave

Tuition reimbursement

Discounts

Job summary

Delaware North in Buffalo, NY is seeking a Data Engineering Manager to lead the data engineering team, shaping the company’s data infrastructure and scalable pipelines to support critical business decisions.

The ideal candidate has 5+ years in data engineering with 3+ in leadership, strong Python/Databricks/AWS/SQL experience, and a proven track record of implementing end-to-end data solutions in Agile environments.

Qualifications

• Bachelor’s degree in computer science or related STEM field.
• Minimum 5 years of data engineering experience with at least 3 years in a leadership role.
• Extensive experience with End-to-End Agile Development Lifecycle.
• Strong technical background in Python, Databricks, AWS, Alation, Airflow, and SQL.
• Experience with data ingestion patterns (RESTful APIs, SQL, flat-files, Data Streams).
• Experience aligning data from disparate sources and implementing CI/CD best practices.
• Experience handling large data sets and building high-performance data solutions.

Responsibilities

• Set team goals and KPIs aligned with business objectives.
• Prioritize and manage data engineering projects to meet deadlines with scalable pipelines.
• Oversee data warehousing, processing, and extraction with high data quality.
• Provide technical guidance on new data technologies and ensure infrastructure stability.
• Drive continuous improvements to data processes and CI/CD practices.

Skills

Leadership

Agile methodologies

Data engineering

Team development

Education

Bachelor’s degree in computer science or related STEM field

Tools

Python

Databricks

AWS

Alation

Airflow

SQL

CI/CD (GitLab/Jenkins/Bamboo)

Job description

Delaware North in Buffalo, NY is seeking a Data Engineering Manager to lead the data engineering team, shaping the company’s data infrastructure and scalable pipelines to support critical business decisions.

The ideal candidate has 5+ years in data engineering with 3+ in leadership, strong Python/Databricks/AWS/SQL experience, and a proven track record of implementing end-to-end data solutions in Agile environments.