Cloud Data Engineer: Spark, Delta Lake & Fabric on Azure

GOVX; New York (NY); Hybrid; USD 120,000 - 140,000; Full time

Benefits offered by this job

Paid Time Off

401(k) plan with match

Competitive Medical, Dental, Vision

Flexible Spending Account

Employee Referral Program

Job summary

An innovative ecommerce platform is seeking a Cloud Data Engineer based in New York, NY to enhance data architecture and support organizational data needs. Key responsibilities include modernizing data integrations, managing data pipelines, and collaborating with cross-functional teams to optimize data access. Ideal candidates will have at least 7 years of experience, a strong background in Spark and Microsoft Fabric, and a relevant degree. Competitive salary range is $120,000 - $140,000 annually, along with comprehensive benefits.

Qualifications

• 7+ years of proven experience deploying and maintaining always-on data services.
• 2+ years building and maintaining Spark notebook-based pipelines in Microsoft Fabric.
• 2+ years of experience working with Microsoft Azure.

Responsibilities

• Support and modernize existing data integrations.
• Craft and maintain efficient data pipeline architecture.
• Work with business analysts and data scientists to design scalable data solutions.

Skills

Spark notebook development

Python scripting

Data pipeline management

Collaboration skills

Problem solving

Python scripting

Delta Lake management

Collaboration skills

Education

Bachelor's degree or equivalent experience

Tools

Microsoft Fabric

Delta Lake

Power BI

SQL Server

Job description

An innovative ecommerce platform is seeking a Cloud Data Engineer based in New York, NY to enhance data architecture and support organizational data needs. Key responsibilities include modernizing data integrations, managing data pipelines, and collaborating with cross-functional teams to optimize data access. Ideal candidates will have at least 7 years of experience, a strong background in Spark and Microsoft Fabric, and a relevant degree. Competitive salary range is $120,000 - $140,000 annually, along with comprehensive benefits.