Senior Data Engineer: Lakehouse & AI Data Pipelines

Greenkey Resources LLC; New York (NY); On-site; USD 140,000 - 190,000; Full time

Job summary

Greenkey Resources LLC is seeking a Senior Data Engineer to design and maintain enterprise data platforms, focusing on secure, scalable analytics, reporting, and AI initiatives. The role emphasizes Medallion Architecture, Delta Lake standards, and Lakehouse solutions on Microsoft Fabric and Azure Data Factory.

You will collaborate with cross-functional teams to deliver data products, optimize storage and integration frameworks, and ensure governance and security compliance across the data

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 5-7 years of experience in enterprise data engineering solutions using Microsoft Fabric, Azure Data Factory, or similar platforms.
• Strong understanding of data integration, ETL/ELT, Lakehouse architecture, and cloud data platforms.
• Proficiency in SQL/T-SQL, Python, REST APIs, and automation technologies.
• Experience with Delta Lake, Parquet, data governance, and metadata management.
• Familiarity with Git, CI/CD, DevOps processes, and Infrastructure-as-Code concepts.
• Strong communication and collaboration skills for partnering with stakeholders.
• Legal industry experience preferred but not required.

Responsibilities

• Design, build, and maintain Microsoft Fabric Lakehouse solutions and enterprise data platforms.
• Develop scalable data ingestion, transformation, and orchestration processes supporting analytics and AI initiatives.
• Implement Medallion Architecture and Delta Lake standards for trusted data products.
• Optimize Lakehouse storage structures and integration frameworks for reliability and scalability.
• Collaborate with business and technical teams to align solutions with organizational needs.
• Ensure adherence to data governance, security, and quality standards.
• Follow SDLC, DevOps, CI/CD, and best practices in data engineering.
• Troubleshoot and optimize data platform performance and reliability.

Skills

Strong communication

Collaboration

SQL/T-SQL

Python

REST APIs

Automation

Education

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field

Tools

Microsoft Fabric

Azure Data Factory

Delta Lake

Parquet

Git

CI/CD

DevOps

Job description

Greenkey Resources LLC is seeking a Senior Data Engineer to design and maintain enterprise data platforms, focusing on secure, scalable analytics, reporting, and AI initiatives. The role emphasizes Medallion Architecture, Delta Lake standards, and Lakehouse solutions on Microsoft Fabric and Azure Data Factory.

You will collaborate with cross-functional teams to deliver data products, optimize storage and integration frameworks, and ensure governance and security compliance across the data