Cloud Data Platform Lead — Lakehouse & BI Pipelines

Stafford Gray

Lansing (MI)

Hybrid

USD 120,000 - 170,000

Full time

5 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Stafford Gray is seeking a Lead Data Engineer to architect a modern cloud data lakehouse and lead data engineering execution. You will mentor engineers, drive data governance, and collaborate with data science and business stakeholders to deliver data and ML solutions.

You will design pipelines across AWS/Azure/GCP, implement medallion-based transformations to Parquet data products, and enable self-service data sharing while ensuring data quality and traceability.

Qualifications

  • Bachelor's degree in Computer Science, Data Science, Information Systems, or a related field.
  • 4+ years hands-on experience building extract-and-load pipelines into an enterprise data lake on a major cloud provider.
  • 4+ years hands-on experience transforming data lake datasets into data products with traceability to systems of record.
  • 2+ years experience enforcing data sharing or access policies on data products.
  • 4+ years programming in Python, PySpark, and SQL, including SQL tuning and loading data into Parquet from databases, flat files, CSV, JSON, and APIs.
  • Experience designing star-schema data stores for BI reporting.
  • Must live within 90 miles of Lansing, MI and be able to work a hybrid onsite schedule.

Responsibilities

  • Design, build, and maintain pipelines that ingest relational, semi-structured, and unstructured data into a cloud data lake on AWS, Azure, or GCP.
  • Transform lake datasets using a Medallion (bronze/silver/gold) approach into Parquet-based data products with traceability to source systems.
  • Implement and enforce data sharing and access policies so subscribers view only entitled versions of data products.
  • Design star-schema operational data stores that feed Power BI and Tableau reporting.
  • Define and uphold standards for data quality, monitoring, validation, and data governance.
  • Lead and mentor data engineers through design reviews, code reviews, and hands-on training.
  • Collaborate with data scientists, analysts, product teams, and business stakeholders to deliver data and ML solutions.

Skills

Mentoring
Data governance
Leadership
Collaboration

Education

Bachelor's degree

Tools

Databricks
Spark
DBT
Glue
Redshift Spectrum
SageMaker
Kafka
Kubernetes
Docker
GitHub
Jenkins
Terraform
YAML
Airflow

Job description

Stafford Gray is seeking a Lead Data Engineer to architect a modern cloud data lakehouse and lead data engineering execution. You will mentor engineers, drive data governance, and collaborate with data science and business stakeholders to deliver data and ML solutions.

You will design pipelines across AWS/Azure/GCP, implement medallion-based transformations to Parquet data products, and enable self-service data sharing while ensuring data quality and traceability.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer (Lakehouse / Databricks)
Lead Data Engineer (Lakehouse / Databricks)

Stafford Gray • Town of Lansing (NY)

Hybrid
USD 130,000 - 180,000
Lead Data Engineer - Cloud Lakehouse (Hybrid, Lansing)
Lead Data Engineer - Cloud Lakehouse (Hybrid, Lansing)

Stafford Gray • Town of Lansing (NY)

Hybrid
USD 130,000 - 180,000
Cloud Data Architect & Lakehouse Engineering Lead
Cloud Data Architect & Lakehouse Engineering Lead

Value Innovation Labs • Lansing (MI)

Hybrid
USD 140,000 - 200,000
Lead Data Engineer
Lead Data Engineer

Stafford Gray • Lansing (MI)

Hybrid
USD 120,000 - 170,000
Data Platform Lead: Lakehouse & Pipelines Architect
Data Platform Lead: Lakehouse & Pipelines Architect

The Friedkin Group • Houston (TX)

On-site
USD 150,000 - 210,000
Cloud Data Engineer - Lakehouse & Delta Lake Lead
Cloud Data Engineer - Lakehouse & Delta Lake Lead

ExlService Holdings, Inc. • Detroit (MI)

On-site
USD 110,000 - 140,000
Senior Data Platform Engineer — Lakehouse & AI Pipelines
Senior Data Platform Engineer — Lakehouse & AI Pipelines

Qualified Health PBC • United States

Hybrid
USD 215,000 - 235,000
Equity
Medical/Dental/Vision insurance
Flexible working hours
+1
Lead Data Engineer — Lakehouse, Governance & AI-Driven Data
Lead Data Engineer — Lakehouse, Governance & AI-Driven Data

MarLabs • United States

Remote
USD 140,000 - 190,000
Lead Data Engineer: Cloud Architect & AI Pipelines
Lead Data Engineer: Cloud Architect & AI Pipelines

Texas Gas Transmission • Houston (TX)

On-site
USD 140,000 - 190,000
Data Engineer: Cloud Lakehouse & Scalable Pipelines
Data Engineer: Cloud Lakehouse & Scalable Pipelines

Harnham • New York (NY)

On-site
USD 110,000 - 160,000