Staff Data Engineer: Azure Databricks Lakehouse & AI Agents

General Motors Company

Warren (MI)

Hybrid

USD 180,000 - 230,000

Full time

3 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

General Motors Company is seeking a Staff Data Engineer (Level 8) to own architecture and delivery of batch and streaming pipelines, agent orchestration, and governed data for AI on the Quality & Safety Data Platform in Warren, MI. The role centers on production-grade lakehouse capabilities and reliable patterns for quality, warranty, and AI applications.

You will migrate legacy ETL to Databricks pipelines, design AI agents and reusable skills, and mentor multiple teams while ensuring measurable

Qualifications

  • 8+ years of professional experience in data/platform engineering or related field.
  • Expert proficiency in Python, SQL, and PySpark with production-quality practices.
  • Hands-on Databricks experience: Delta Lake, Unity Catalog, Workflows/Jobs, DLT, medallion lakehouse.
  • Leadership in modernizing ETL/data warehouses and data reconciliation.
  • Experience building AI agents and agent orchestration with tool calling.

Responsibilities

  • Architect and productionize reliable batch and streaming data products in Azure Databricks.
  • Lead migration of legacy ETL to Databricks pipelines with cutover plans.
  • Design and operate AI agents and reusable skills for automation and documentation.
  • Engineer agent orchestration for multi-agent workflows with tool calling and retries.
  • Prepare governed data for AI including retrieval, vector search, and lineage.
  • Set CI/CD, workload identity, security, cost, observability for production releases.
  • Mentor senior engineers and collaborate with cross-functional teams.

Skills

Python
SQL
Apache Spark (PySpark)
Databricks
AI agents
CI/CD
GitHub Actions
Cloud platforms (Azure)

Education

Bachelor’s degree in Computer Science, Software Engineering, Data Engineering, or equivalent experience

Tools

IBM DataStage
Oracle
DB2
Claude Agent SDK
OpenAI Agents SDK
LangGraph
LangChain
Databricks Mosaic AI Agent Framework
Cursor
Claude Code
GitHub Copilot

Job description

General Motors Company is seeking a Staff Data Engineer (Level 8) to own architecture and delivery of batch and streaming pipelines, agent orchestration, and governed data for AI on the Quality & Safety Data Platform in Warren, MI. The role centers on production-grade lakehouse capabilities and reliable patterns for quality, warranty, and AI applications.

You will migrate legacy ETL to Databricks pipelines, design AI agents and reusable skills, and mentor multiple teams while ensuring measurable

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Data Engineer - AI-Driven Lakehouse Architect
Staff Data Engineer - AI-Driven Lakehouse Architect

General Motors LLC • United States

Hybrid
USD 160,000 - 211,000
Relocation benefits
GM health and wellbeing benefits
Data Platform Engineer - AI-Driven Lakehouse on Azure
Data Platform Engineer - AI-Driven Lakehouse on Azure

General Motors Company • Austin (TX)

Hybrid
USD 160,000 - 211,000
Company vehicle program
Health and wellbeing benefits
Tuition assistance
Staff Data Engineer – Agentic AI, AI Orchestration & Data Platforms
Staff Data Engineer – Agentic AI, AI Orchestration & Data Platforms

General Motors Company • Warren (MI)

Hybrid
USD 180,000 - 230,000
Data Engineering Manager: AI-Driven Lakehouse Leader
Data Engineering Manager: AI-Driven Lakehouse Leader

General Motors Company • Jackson (TN)

Hybrid
USD 140,000 - 190,000
Senior Data & AI Quality Engineer (Hybrid)
Senior Data & AI Quality Engineer (Hybrid)

General Motors Company • Austin (TX)

Hybrid
USD 125,000 - 169,000
Medical, dental, vision
Health Savings Account
Flexible Spending Accounts
+7
Senior AI/Data Engineer — Cloud-Native Backend & Pipelines
Senior AI/Data Engineer — Cloud-Native Backend & Pipelines

General Motors Company • Austin (TX)

Hybrid
USD 120,000 - 180,000
Hybrid work model
Relocation benefits
Senior Data Engineer: Azure Lakehouse & AI Pipelines (Remote)
Senior Data Engineer: Azure Lakehouse & AI Pipelines (Remote)

Detroit Startup Council • Dearborn (MI)

Remote
USD 120,000 - 180,000
Medical, dental, vision insurance
401(k) with employer matching
Paid time off and holidays
Senior Data Engineer – Azure Databricks & CRM Pipelines
Senior Data Engineer – Azure Databricks & CRM Pipelines

General Motors Company • Austin (TX)

Hybrid
USD 130,000 - 190,000
Relocation benefits available
Lead Data Engineer, Production Pipelines & Governance
Lead Data Engineer, Production Pipelines & Governance

General Motors LLC • United States

Hybrid
USD 159,000 - 221,000
Health and wellbeing benefits
Relocation benefits
GM employee discounts
Staff Data Software Engineer - AI & Data Pipelines
Staff Data Software Engineer - AI & Data Pipelines

General Motors LLC • Sunnyvale (CA)

Hybrid
USD 260,000 - 333,000