Lead Data Engineer (Lakehouse / Databricks)

Stafford Gray

Lansing (MI)

Hybrid

USD 140,000 - 180,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Stafford Gray is seeking a hands-on Lead Data Engineer to architect and build a modern cloud data lakehouse for a large public-sector organization. You’ll be the technical lead for data engineering, designing and building pipelines, turning raw data into governed data products, and coaching in-house data engineers on standards.

You’ll work with data scientists, analysts, and an external research team, setting direction while still coding daily.

Qualifications

  • Bachelor’s degree in Computer Science, Data Science, Information Systems, or a related field.
  • 4+ years of hands-on experience building extract-and-load pipelines into an enterprise data lake on a major cloud provider.
  • 4+ years of hands-on experience transforming data lake datasets into data products with traceability to the systems of record.
  • 2+ years of experience enforcing data sharing or access policies on data products.
  • 4+ years of programming in Python, PySpark, and SQL, including SQL tuning and loading data from databases, flat files, CSV, JSON, and APIs into Parquet.
  • Experience designing star-schema data stores for BI reporting.
  • Must live within 90 miles of Lansing, MI at the time of submission and be able to work a hybrid onsite schedule.

Responsibilities

  • Design, build, and maintain pipelines that ingest relational, semi-structured, and unstructured data into a cloud data lake on AWS, Azure, or GCP.
  • Transform lake datasets through a Medallion (bronze/silver/gold) architecture into Parquet-based data products, with traceability to source systems.
  • Enforce data sharing and access policies so subscribers see only entitled versions of a data product.
  • Design star-schema operational data stores that feed Power BI and Tableau reporting.
  • Set data quality, monitoring, validation, and governance standards.
  • Lead and mentor data engineers through design reviews and hands-on training.
  • Partner with data scientists, analysts, product teams, and business stakeholders to deliver data and ML solutions.

Skills

Python
PySpark
SQL
Data modeling
Data governance
BI reporting

Education

Bachelor's degree in Computer Science / Data Science / Information Systems

Tools

Databricks
Spark
DBT
Glue
Redshift Spectrum
SageMaker
Kafka
Kubernetes
Docker
GitHub
Jenkins
Terraform
YAML
Airflow

Job description

Stafford Gray is looking for a hands-on Lead Data Engineer to architect and build a modern cloud data lakehouse for a large public-sector organization. You’ll be the technical lead for data engineering. You’ll design and build the pipelines that feed the enterprise data lake, turn raw data into governed data products, and coach the in-house data engineers on standards and best practices. You’ll work alongside data scientists, analysts, and an external research team. This role is for someone who still builds every day and also sets direction for the team.

What you’ll do

  • Design, build, and maintain pipelines that ingest relational, semi-structured, and unstructured data into a cloud data lake on AWS, Azure, or GCP.
  • Transform lake datasets through a Medallion (bronze/silver/gold) architecture into Parquet-based data products, with every attribute traceable back to its source system.
  • Enforce data sharing and access policies so each subscriber sees only the version of a data product they’re entitled to.
  • Design star-schema operational data stores that feed Power BI and Tableau reporting.
  • Set data quality, monitoring, validation, and governance standards.
  • Lead and mentor data engineers through design reviews, code reviews, and hands-on training.
  • Partner with data scientists, analysts, product teams, and business stakeholders to deliver data and ML solutions.

Required

  • Bachelor’s degree in Computer Science, Data Science, Information Systems, or a related field.
  • 4+ years of hands-on experience building extract-and-load pipelines into an enterprise data lake on a major cloud provider.
  • 4+ years of hands-on experience transforming data lake datasets into data products with traceability to the systems of record.
  • 2+ years of experience enforcing data sharing or access policies on data products.
  • 4+ years of programming in Python, PySpark, and SQL, including SQL tuning and loading data from databases, flat files, CSV, JSON, and APIs into Parquet.
  • Experience designing star-schema data stores for BI reporting.
  • Must live within 90 miles of Lansing, MI at the time of submission and be able to work a hybrid onsite schedule.

Preferred

  • Databricks, Spark, DBT, Glue, Redshift Spectrum, and SageMaker.
  • Kafka, Kubernetes, and Docker.
  • DevOps and infrastructure-as-code: GitHub, Jenkins, Terraform, YAML, and Airflow DAGs.
  • Cloud-native data governance and security tooling.
  • Experience with NoSQL and graph databases, and with ML pipelines.
  • A track record of championing data engineering standards across a developer community.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer (Lakehouse / Databricks)
Lead Data Engineer (Lakehouse / Databricks)

Stafford Gray • Town of Lansing (NY)

Hybrid
USD 130,000 - 180,000
Lead Data Engineer
Lead Data Engineer

Stafford Gray • Lansing (MI)

Hybrid
USD 120,000 - 170,000
Lead Data Engineer - Cloud Lakehouse (Hybrid, Lansing)
Lead Data Engineer - Cloud Lakehouse (Hybrid, Lansing)

Stafford Gray • Town of Lansing (NY)

Hybrid
USD 130,000 - 180,000
Lead Data Engineer
Lead Data Engineer

MasterApp Labs • Lansing (MI)

Hybrid
USD 83,000 - 165,000
401(k) matching
Dental insurance
Health insurance
+1
Cloud Data Platform Lead — Lakehouse & BI Pipelines
Cloud Data Platform Lead — Lakehouse & BI Pipelines

Stafford Gray • Lansing (MI)

Hybrid
USD 120,000 - 170,000
Data Warehouse Architect / Data Engineering Lead
Data Warehouse Architect / Data Engineering Lead

Value Innovation Labs • Lansing (MI)

Hybrid
USD 140,000 - 200,000
Lakehouse Data Engineer Lead | Cloud Pipelines & Data
Lakehouse Data Engineer Lead | Cloud Pipelines & Data

Stafford Gray • Lansing (MI)

Hybrid
USD 140,000 - 180,000
Lead Data Engineer/Architect
Lead Data Engineer/Architect

I O DATASPHERE • Lansing (MI)

On-site
USD 90,000 - 130,000
Lead Data Engineer/Architect - DHHS
Lead Data Engineer/Architect - DHHS

IO Datasphere, Inc. • Lansing (MI)

On-site
USD 90,000 - 140,000
Lead Data Engineer
Lead Data Engineer

Astrana Health • United States

Remote
USD 140,000 - 190,000