Remote Senior Data Engineer - Lead End-to-End Pipelines

Crate and Barrel; Northbrook (IL); On-site; USD 100,000 - 130,000; Full time

Job summary

Crate and Barrel is looking for a Senior Data Engineer to lead the technical execution of scalable data pipelines that drive their national retail data platform. The ideal candidate will have over 5 years of data engineering experience, with in-depth knowledge of Google Cloud tools such as BigQuery and Google Dataflow.

This remote position offers the chance to work closely with various teams to ensure high-quality data operations. A Bachelor's degree in a related field and strong programming skills in Python and SQL are essential.

Qualifications

• 5+ years of dedicated Data Engineering experience, with at least 2 years in a lead or senior capacity.
• Deep proficiency in BigQuery, Google Dataflow, Google Cloud Storage, and Dataform.
• Expert-level Python and SQL are mandatory.

Responsibilities

• Lead the technical construction of complex data pipelines.
• Manage and maintain enterprise-level orchestration outside of the Google Cloud Platform.
• Act as the primary engineering point of contact for external teams.
• Build and maintain high-velocity streaming and near-time pathways using Google Dataflow and Confluent Kafka.
• Partner with the Governance team for technical controls, including privacy compliance workflows.
• Lead the team’s Git-flow process via BitBucket and manage code for deployment.
• Perform high-quality code reviews and mentor junior engineers.

Skills

Data Engineering experience

BigQuery

Google Dataflow

Python

SQL

Confluent Kafka

BitBucket (Git-flow)

Dataform

Education

Bachelor’s degree in Computer Science, Engineering, or a related technical field

Tools

Google Cloud Storage

Enterprise Orchestration tools (e.g., Tidal)

Job description

Crate and Barrel is looking for a Senior Data Engineer to lead the technical execution of scalable data pipelines that drive their national retail data platform. The ideal candidate will have over 5 years of data engineering experience, with in-depth knowledge of Google Cloud tools such as BigQuery and Google Dataflow.

This remote position offers the chance to work closely with various teams to ensure high-quality data operations. A Bachelor's degree in a related field and strong programming skills in Python and SQL are essential.