Senior Data Engineer

Green Key Resources LLC; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Greenkey Resources LLC is seeking a Senior Data Engineer to design and maintain enterprise data platforms, focusing on secure, scalable analytics, reporting, and AI initiatives. The role emphasizes Medallion Architecture, Delta Lake standards, and Lakehouse solutions on Microsoft Fabric and Azure Data Factory.

You will collaborate with cross-functional teams to deliver data products, optimize storage and integration frameworks, and ensure governance and security compliance across the data

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 5-7 years of experience in enterprise data engineering solutions using Microsoft Fabric, Azure Data Factory, or similar platforms.
• Strong understanding of data integration, ETL/ELT, Lakehouse architecture, and cloud data platforms.
• Proficiency in SQL/T-SQL, Python, REST APIs, and automation technologies.
• Experience with Delta Lake, Parquet, data governance, and metadata management.
• Familiarity with Git, CI/CD, DevOps processes, and Infrastructure-as-Code concepts.
• Strong communication and collaboration skills for partnering with stakeholders.
• Legal industry experience preferred but not required.

Responsibilities

• Design, build, and maintain Microsoft Fabric Lakehouse solutions and enterprise data platforms.
• Develop scalable data ingestion, transformation, and orchestration processes supporting analytics and AI initiatives.
• Implement Medallion Architecture and Delta Lake standards for trusted data products.
• Optimize Lakehouse storage structures and integration frameworks for reliability and scalability.
• Collaborate with business and technical teams to align solutions with organizational needs.
• Ensure adherence to data governance, security, and quality standards.
• Follow SDLC, DevOps, CI/CD, and best practices in data engineering.
• Troubleshoot and optimize data platform performance and reliability.

Skills

Strong communication

Collaboration

SQL/T-SQL

Python

REST APIs

Automation

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field

Tools

Microsoft Fabric

Azure Data Factory

Delta Lake

Parquet

Git

CI/CD

DevOps

Job description

Senior Data Engineer Overview

• The Senior Data Engineer designs and maintains enterprise data platforms, ensuring secure, scalable solutions for analytics, reporting, and AI initiatives.
• Collaborates with cross-functional teams to deliver data solutions aligned with organizational requirements and objectives.
• Develops robust data pipelines and transformation processes using modern cloud technologies and frameworks.
• Implements Medallion Architecture and enterprise data models to deliver high-quality data products.
• Optimizes data storage structures and integration frameworks for performance and cost efficiency.
• Ensures compliance with data governance, security, and privacy standards in partnership with relevant teams.
• Evaluates emerging cloud and analytics technologies to enhance data engineering capabilities.
• Monitors and optimizes data platform performance and operational processes.

Senior Data Engineer Key Responsibilities & Duties

• Design, build, and maintain Microsoft Fabric Lakehouse solutions and enterprise data platforms.
• Develop scalable data ingestion, transformation, and orchestration processes supporting analytics and AI initiatives.
• Implement Medallion Architecture and Delta Lake standards for trusted data products.
• Optimize Lakehouse storage structures and integration frameworks for reliability and scalability.
• Collaborate with business and technical teams to align solutions with organizational needs.
• Ensure adherence to data governance, security, and quality standards.
• Follow SDLC, DevOps, CI/CD, and best practices in data engineering.
• Troubleshoot and optimize data platform performance and reliability.

Senior Data Engineer Job Requirements

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 5-7 years of experience in enterprise data engineering solutions using Microsoft Fabric, Azure Data Factory, or similar platforms.
• Strong understanding of data integration, ETL/ELT, Lakehouse architecture, and cloud data platforms.
• Proficiency in SQL/T-SQL, Python, REST APIs, and automation technologies.
• Experience with Delta Lake, Parquet, data governance, and metadata management.
• Familiarity with Git, CI/CD, DevOps processes, and Infrastructure-as-Code concepts.
• Strong communication and collaboration skills for partnering with stakeholders.
• Legal industry experience preferred but not required.