Senior Data Engineer - Cloud Data & AI Pipelines

Green Key Resources; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Green Key Resources is seeking a Senior Data Engineer to lead the development and optimization of data engineering processes using Microsoft Fabric and SQL Server technologies.

You will collaborate with cross-functional teams to ensure data integrity for critical business processes, migrate legacy systems to modern cloud platforms, and design data warehouse architectures with medallion layering. Strong Power BI modeling and governance are required.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, or related field.
• 7+ years of experience in data engineering, SQL development, and ETL workflows.
• Proficiency in Microsoft SQL Server, T-SQL, and Azure SQL.
• Experience with Informatica PowerCenter and Microsoft Fabric tools.
• Strong knowledge of data warehouse design and medallion architecture.
• Hands-on Power BI semantic model development and DAX.
• Familiarity with Python for data engineering tasks.
• Microsoft certifications such as DP-700 or DP-600 preferred.

Responsibilities

• Lead development and optimization of data engineering processes using Fabric and SQL Server.
• Collaborate with cross-functional teams to ensure data integrity and reliability.
• Contribute to migration of legacy systems to modern cloud-based data platforms.
• Design and implement data warehouse architectures using medallion layering.
• Develop Power BI semantic models with robust data entitlement rules for secure reporting.
• Ensure compliance with regulatory requirements and maintain data governance.
• Support production environments, troubleshoot issues, and optimize workflows for efficiency.
• Drive innovation by integrating AI solutions and modern data engineering practices.
• Design and optimize SQL Server objects, including schemas, stored procedures, and queries.
• Develop and maintain ETL workflows using Informatica PowerCenter and Microsoft Fabric tools.
• Implement data warehouse solutions with dimensional modeling and medallion architecture.
• Create and certify Power BI semantic models with row-level security and entitlement rules.
• Monitor production processes, troubleshoot failures, and ensure uninterrupted data operations.
• Apply Git version control and CI/CD pipelines to data engineering workflows.
• Document technical processes, data lineage, and operational runbooks for team collaboration.
• Collaborate with stakeholders to align data solutions with business requirements.

Skills

Data engineering

SQL development

ETL workflows

Power BI modeling

Azure SQL

T-SQL

Python

Data governance

Git CI/CD

Education

Bachelor’s degree in Computer Science/Information Systems

Tools

Informatica PowerCenter

Microsoft Fabric

Microsoft SQL Server

Power BI tools

Azure

Job description

Green Key Resources is seeking a Senior Data Engineer to lead the development and optimization of data engineering processes using Microsoft Fabric and SQL Server technologies.

You will collaborate with cross-functional teams to ensure data integrity for critical business processes, migrate legacy systems to modern cloud platforms, and design data warehouse architectures with medallion layering. Strong Power BI modeling and governance are required.