Senior Data Engineer: Cloud Data Platform & AI-Driven ETL

Green Key Resources; New York (NY); On-site; USD 150,000 - 210,000; Full time

Job summary

Green Key Resources in New York is seeking a Senior Data Engineer to lead data engineering initiatives using Microsoft Fabric and SQL Server. You will design scalable data pipelines, migrate legacy systems, and develop medallion-based data warehouses and Power BI models with row-level security.

Collaboration with cross-functional teams will ensure data integrity, governance, and compliance while adopting AI-enabled improvements and modern ETL practices.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems or related field.
• 7+ years of experience in data engineering, SQL development, and ETL workflows.
• Proficiency in Microsoft SQL Server, T-SQL, and Azure SQL.
• Experience with Informatica PowerCenter and Microsoft Fabric tools.
• Strong knowledge of data warehouse design and medallion architecture.
• Hands-on experience with Power BI semantic model development and DAX.
• Familiarity with Python for data engineering tasks.
• M pozitiv Microsoft DP-700/DP-600 certifications preferred.

Responsibilities

• Lead the development and optimization of data engineering processes using Microsoft Fabric and SQL Server technologies.
• Collaborate with cross-functional teams to ensure data integrity and reliability for critical business processes.
• Contribute to migration of legacy systems to modern cloud-based data platforms.
• Design and implement data warehouse architectures using medallion layering.
• Develop Power BI semantic models with robust data entitlement rules for secure reporting.
• Ensure compliance with regulatory requirements and maintain data governance standards.
• Support production environments, troubleshoot issues, and optimize workflows for efficiency.
• Drive innovation by integrating AI solutions and modern data engineering practices.
• Design and optimize SQL Server objects, including schemas, stored procedures, and queries.
• Develop ETL workflows using Informatica PowerCenter and Microsoft Fabric tools.
• Implement data warehouse solutions with dimensional modeling and medallion architecture.
• Create and certify Power BI semantic models with row-level security and entitlement rules.
• Monitor production processes, troubleshoot failures, and ensure uninterrupted data operations.
• Apply Git version control and CI/CD pipelines to data engineering workflows.
• Document technical processes, data lineage, and operational runbooks for team collaboration.
• Collaborate with stakeholders to align data solutions with business requirements.

Skills

Data Engineer

SQL Development

ETL Workflows

Power BI

T-SQL

Python

Azure SQL

Informatica PowerCenter

Power BI DAX

CI/CD

Git

Data Governance

Medallion Architecture

Education

Bachelor’s degree in Computer Science or Information Systems

Tools

Microsoft Fabric

Informatica PowerCenter

Azure SQL

Power BI

Job description

Green Key Resources in New York is seeking a Senior Data Engineer to lead data engineering initiatives using Microsoft Fabric and SQL Server. You will design scalable data pipelines, migrate legacy systems, and develop medallion-based data warehouses and Power BI models with row-level security.

Collaboration with cross-functional teams will ensure data integrity, governance, and compliance while adopting AI-enabled improvements and modern ETL practices.