Lead Data Platform Architect | Lakehouse & ML Pipelines

AiQualTest LLC

Town of Lansing (NY)

On-site

USD 120,000 - 180,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Michigan Department of Health and Human Services (DHHS) in Lansing seeks a Data Engineering Lead to drive data modeling, lakehouse architectures, and ML product delivery within an agile DevOps framework. You will lead a team of data engineers, oversee data pipelines and governance, and collaborate with data scientists, analysts, and business stakeholders to support statewide health analytics goals.

Duration is 1 year with mandatory on-site presence; C2C possible and compensation depends on

Qualifications

  • 4+ years building data lakes on cloud platforms (AWS/Azure/GCP).
  • 2+ years enforcing data sharing policies for data products.
  • Experience with Spark, Kafka, Kubernetes, SageMaker, DBT and Docker.
  • BS in CS/DS with 4+ years relevant experience.
  • Proficiency in Python, PySpark, SQL for data extraction and processing.
  • Experience delivering star-schema data stores for visualization with Power BI/Tableau.

Responsibilities

  • Lead data engineering for modeling, lakehouse, and ML product delivery within an agile DevOps framework.
  • Serve as the primary state technology lead and train DAV data engineers.
  • Oversee design, development and maintenance of data pipelines for analytics and operations.
  • Architect and optimize data infrastructure including storage, orchestration and ETL/ELT processes.
  • Ensure data quality, reliability and security with governance practices.
  • Lead and mentor data engineering staff, reviewing designs and code.
  • Collaborate with data scientists, analysts, product teams and stakeholders to meet organizational needs.

Skills

Data Lake Hydration
Cloud Platforms
Spark & Kafka
SageMaker
SQL/NoSQL
Python / PySpark
DevOps Pipelines

Education

BS in CS/DS

Tools

Docker
Databricks
SageMaker
Kubernetes
Power BI
Tableau

Job description

Michigan Department of Health and Human Services (DHHS) in Lansing seeks a Data Engineering Lead to drive data modeling, lakehouse architectures, and ML product delivery within an agile DevOps framework. You will lead a team of data engineers, oversee data pipelines and governance, and collaborate with data scientists, analysts, and business stakeholders to support statewide health analytics goals.

Duration is 1 year with mandatory on-site presence; C2C possible and compensation depends on

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer & Architect — Lakehouse & ML Pipelines
Lead Data Engineer & Architect — Lakehouse & ML Pipelines

I O DATASPHERE • Lansing (MI)

On-site
USD 90,000 - 130,000
MI-Lead Data Engineer/Architect
MI-Lead Data Engineer/Architect

AiQualTest LLC • Town of Lansing (NY)

On-site
USD 120,000 - 180,000
Data Engineering Lead & Lakehouse Architect
Data Engineering Lead & Lakehouse Architect

IO Datasphere, Inc. • Lansing (MI)

On-site
USD 90,000 - 140,000
Data Engineering Lead: Lakehouse & ML Pipelines
Data Engineering Lead: Lakehouse & ML Pipelines

Zenfreed, LLC • Lansing (MI)

Hybrid
USD 120,000 - 180,000
Data Engineer Lead / Data Warehouse Architect
Data Engineer Lead / Data Warehouse Architect

Govan Systems inc • Lansing (MI)

Hybrid
USD 120,000 - 180,000
Lead Data Engineer - Cloud Lakehouse (Hybrid, Lansing)
Lead Data Engineer - Cloud Lakehouse (Hybrid, Lansing)

Stafford Gray • Town of Lansing (NY)

Hybrid
USD 130,000 - 180,000
Lead Data Engineer/Architect - DHHS
Lead Data Engineer/Architect - DHHS

IO Datasphere, Inc. • Lansing (MI)

On-site
USD 90,000 - 140,000
Hybrid Data Engineering Lead: Lakehouse & ML
Hybrid Data Engineering Lead: Lakehouse & ML

MasterApp Labs • Lansing (MI)

Hybrid
USD 83,000 - 165,000
401(k) matching
Dental insurance
Health insurance
+1
Data Engineer Lead: Lakehouse & ML Pipelines, DevOps
Data Engineer Lead: Lakehouse & ML Pipelines, DevOps

Ethereum Technologies • Lansing (MI)

On-site
USD 83,000 - 118,000
Lead Data Engineer/Architect
Lead Data Engineer/Architect

I O DATASPHERE • Lansing (MI)

On-site
USD 90,000 - 130,000