Cloud Data Engineer: Spark, Delta Lake & Azure Pipelines

GOVX; Colorado; Hybrid; USD 120,000 - 140,000; Full time

Benefits offered by this job

Paid Time Off

Competitive Medical Insurances

401(k) plan with discretionary match

Employee Referral Program

Job summary

A leading ecommerce company is seeking a Cloud Data Engineer to support and transform data capabilities across products by implementing modernized data architecture. Responsibilities include maintaining data pipelines, optimizing Delta Lake management for performance, and collaborating with business analysts to create scalable data solutions. The ideal candidate has extensive experience in Azure, Spark, and data engineering, providing an exciting opportunity to enhance data accessibility and quality within the organization.

Qualifications

• 7+ years of proven experience deploying data services.
• 2+ years building Spark notebook pipelines in Microsoft Fabric.
• Strong collaboration skills with technical teams.

Responsibilities

• Modernize data integrations and maintain data pipeline architecture.
• Create and optimize Delta Lake tables and data delivery processes.
• Work with analysts to translate business requirements into data solutions.

Skills

Data Lakehouse

ETL process optimization

Spark scripting

Power BI integration

SQL query authoring

Python

Data engineering collaboration

Education

Bachelor's degree or equivalent experience

Tools

Microsoft Fabric

Delta Lake

Azure

Git

Job description

A leading ecommerce company is seeking a Cloud Data Engineer to support and transform data capabilities across products by implementing modernized data architecture. Responsibilities include maintaining data pipelines, optimizing Delta Lake management for performance, and collaborating with business analysts to create scalable data solutions. The ideal candidate has extensive experience in Azure, Spark, and data engineering, providing an exciting opportunity to enhance data accessibility and quality within the organization.