Data Engineer

M3 Placement & Partnership; New York (NY); On-site; USD 120,000 - 190,000; Full time

Job summary

NYSTEC is seeking a Data Engineer to join the Business Intelligence team, shaping the enterprise data platform to support analytics, reporting, and AI initiatives.

You will design and maintain scalable data pipelines, warehouses, and lakehouses, ensuring data quality, security, and accessibility across cloud and on-premise environments, and collaborating with stakeholders.

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, IT, or related field or equivalent experience.
• 5+ years designing, developing, and supporting enterprise data platforms.
• Proven Data Engineer experience, not primarily Data Analyst.
• Ability to manage multiple priorities independently and collaboratively.
• Strong communication and stakeholder engagement skills.
• Authorized to work in the United States without sponsorship.

Responsibilities

• Design, develop, and maintain scalable enterprise data pipelines and integration solutions.
• Build and support data warehouses, lakehouses, and analytical data repositories.
• Develop and maintain ETL/ELT processes to ingest, transform, validate, and deliver data from multiple sources.
• Create and optimize data models that support reporting, analytics, and BI initiatives.
• Develop SQL, Python, and PySpark solutions for data processing, automation, and analytics.
• Integrate data from enterprise apps, APIs, databases, cloud environments, and third-party systems.
• Implement and maintain data governance, security, metadata management, and data quality standards.
• Monitor and optimize performance, scalability, and reliability of the data platform.
• Collaborate with business stakeholders and technical teams to translate needs into scalable data solutions.
• Support modernization efforts related to analytics, AI, and self-service reporting.

Skills

Microsoft Fabric

SQL

Python

PySpark

Data governance

Data modeling

ETL/ELT

Data integration

Security/compliance

Communication

Education

Bachelor's degree

Job description

About the Company: Our client, NYSTEC, is a respected, mission-driven organization focused on leveraging data, technology, and innovation to support strategic decision-making and operational excellence. As the organization continues to invest in its enterprise data capabilities, it is seeking a skilled Data Engineer to help advance its modern data platform and support future analytics, reporting, and AI initiatives.

About the Role: The Data Engineer will serve as a key member of the Business Intelligence team, responsible for designing, developing, and maintaining the organization's enterprise data platform. This individual will play a critical role in building scalable data solutions, supporting the continued adoption of Microsoft Fabric, and ensuring data is secure, reliable, and accessible across the organization.

This is a highly visible position with significant ownership and influence over data architecture, integration strategies, and platform performance. The ideal candidate is a true data engineering professional who can independently develop and support enterprise data solutions while partnering effectively with both technical and business stakeholders.

Responsibilities:

• Design, develop, and maintain scalable enterprise data pipelines and integration solutions.
• Build and support data warehouses, lakehouses, and analytical data repositories.
• Develop and maintain ETL/ELT processes to ingest, transform, validate, and deliver data from multiple internal and external sources.
• Create and optimize data models that support reporting, analytics, and business intelligence initiatives.
• Develop solutions using SQL, Python, and PySpark to support data processing, automation, and analytics.
• Integrate data from enterprise applications, APIs, relational databases, cloud environments, and third-party systems.
• Implement and maintain data governance, security, metadata management, and data quality standards.
• Monitor and optimize the performance, scalability, and reliability of the organization's data platform.
• Collaborate with business stakeholders and technical teams to translate business needs into scalable data solutions.
• Support ongoing modernization efforts and future initiatives related to analytics, artificial intelligence, and self-service reporting.

Qualifications:

• Bachelor's degree in Computer Science, Information Systems, Data Engineering, Information Technology, or a related field, or an equivalent combination of education and experience.
• Minimum of 5 years of experience designing, developing, and supporting enterprise data platforms.
• Proven experience working in a Data Engineer role rather than a primarily Data Analyst-focused position.
• Ability to work independently while managing multiple priorities in a collaborative environment.
• Strong communication and stakeholder engagement skills.
• Authorization to work in the United States without sponsorship.

Required Skills:

• Hands-on experience with Microsoft Fabric and modern Microsoft data technologies.
• Advanced SQL development skills, including query optimization, database design, and performance tuning.
• Strong proficiency with Python and/or PySpark.
• Experience designing and supporting ETL/ELT processes and data integration solutions.
• Experience building and supporting data warehouses, lakehouses, and enterprise data models.
• Strong understanding of enterprise data architecture, governance, security, and data quality best practices.
• Experience integrating data from multiple source systems, APIs, databases, and cloud platforms.
• Strong analytical, troubleshooting, and problem-solving abilities.

Certifications (Preferred):

• Microsoft Certified: Fabric Analytics Engineer Associate (DP-600)
• Other Microsoft data platform certifications

All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, veteran status, or any other status protected by law.