Manager of Data Engineering

New York Technology Partners; Chicago (IL); On-site; USD 160,000 - 210,000; Full time

Job summary

New York Technology Partners in Chicago seeks an experienced Manager, Data Engineering to lead a high-impact payments migration program. You will design and execute scalable data solutions, modernizing enterprise data architecture, cloud solutions, and AI-enabled capabilities.

You will partner with cross-functional teams to migrate critical payment data with minimal disruption, build cloud-native data platforms on Azure, and drive data governance, quality, and performance across the program.

Qualifications

• Experience leading enterprise-scale data engineering or migration programs.
• Strong expertise with Microsoft Azure data solutions.
• Experience building scalable data pipelines and cloud-native analytics.
• Familiarity with AI-enabled data modernization is a plus.
• Excellent communication and stakeholder management.

Responsibilities

• Lead architecture and delivery of large-scale payments data migration initiatives.
• Design scalable, cloud-native data solutions using Azure technologies.
• Build and optimize enterprise data platforms for high-volume processing and analytics.
• Develop modern data architectures using Azure Databricks, ADF, and Data Lakes.
• Partner with engineering, architecture, and business stakeholders on data quality and governance.
• Support AI-enabled data modernization by integrating intelligent capabilities into platforms.
• Drive best practices for data integration, scalability, security, and performance.

Skills

Data engineering

Azure

Data governance

Data integration

Stakeholder management

AI-enabled data

Agile

Cloud architecture

Tools

MongoDB

Kafka

NoSQL databases

Job description

We're looking for an experienced Manager, Data Engineering to lead a high-impact payments migration program focused on modernizing enterprise data architecture, cloud solutions, and AI-enabled capabilities.

In this role, you'll drive the design and execution of scalable data solutions while partnering with cross-functional teams to ensure successful migration of critical payment data with minimal business disruption.

What You'll Do

• Lead the architecture and delivery of large-scale payments data migration initiatives.
• Design scalable, cloud-native data solutions using Azure technologies.
• Build and optimize enterprise data platforms supporting high-volume processing and analytics.
• Develop and implement modern data architectures utilizing Azure Databricks, Azure Data Factory (ADF), and Data Lakes.
• Partner with engineering, architecture, and business stakeholders to ensure data quality, governance, and successful project execution.
• Support AI-enabled data modernization initiatives by incorporating intelligent capabilities into enterprise data platforms.
• Drive best practices for data integration, scalability, security, and performance.

What We’re Looking For

• Experience leading enterprise-scale data engineering or data migration programs.
• Strong expertise designing and implementing cloud-based data solutions within the Microsoft Azure ecosystem.
• Hands-on experience with:
• MongoDB or other NoSQL databases
• Kafka
• Strong understanding of modern data architecture, integration patterns, and enterprise data platforms.
• Experience building scalable, reliable data pipelines and cloud-native analytics solutions.
• Exposure to AI-enabled platforms and modern data modernization initiatives is highly desirable.
• Excellent communication and stakeholder management skills with the ability to collaborate across technical and business teams.

Preferred Qualifications

• Experience working in payments, financial services, or other highly regulated industries.
• Knowledge of enterprise data governance and cloud architecture best practices.
• Experience leading technical teams in Agile environments.