Databricks Data Engineer: Pipelines & Data Products

General Motors; Mountain View (CA); Hybrid; USD 139,000 - 207,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision care

GM vehicle discounts

Job summary

General Motors is seeking a data engineer to design, build, and support Databricks-based data pipelines and governance across enterprise applications. The role focuses on creating trusted data products for analytics, reporting, and AI use cases, partnering with product owners, architects, and data consumers.

You will implement end-to-end ETL/ELT workflows, develop Bronze-Silver-Gold data products, and ensure data quality, scalability, and reuse across teams.

Qualifications

• Bachelor’s degree in Computer Science, Information Systems, Data Engineering, Data Science, Engineering, or a related field.
• 5+ years of experience as a data engineer, ETL developer, or integration engineer building production-grade data pipelines and data products.
• Hands-on experience with Databricks for data engineering and analytics enablement.
• Strong SQL skills in Databricks.
• Experience building and supporting ETL/ELT pipelines in Databricks.
• Experience developing pipelines using Python, notebooks, DataStage, and scalable data transformation patterns.
• Experience with workflow orchestration, dependency management, scheduling, monitoring, and operational support of production pipelines.
• Proven experience designing and implementing dimensional, layered, or medallion-style data models for analytics and operational use cases.
• Strong knowledge of data warehousing and ETL/ELT concepts.

Responsibilities

• Design, build, and maintain scalable data pipelines in Databricks to ingest, transform, validate, and publish trusted data products for analytics, reporting, and AI use cases.
• Develop and support end-to-end ETL/ELT workflows using Databricks notebooks, Python, Spark, and SQL, including orchestration, parameterization, error handling, restartability, and performance optimization.
• Build and maintain Bronze, Silver, and Gold data products that are reusable, governed, and aligned to business and downstream consumption needs.
• Build and support integrations into Databricks and between enterprise applications, including DataStage-based workflows.
• Implement pipeline logic for ingestion, standardization, cleansing, enrichment, joins, aggregations, and publishing of curated data assets.

Skills

SQL skills

Databricks experience

Python programming

ETL/ELT pipelines

Data governance

Collaboration

Problem solving

Communication

Ownership

Education

Bachelor’s degree in CS/IS/DE/DS/Engineering

Tools

Databricks

DataStage

Python

Spark

SQL

GitHub

Job description

General Motors is seeking a data engineer to design, build, and support Databricks-based data pipelines and governance across enterprise applications. The role focuses on creating trusted data products for analytics, reporting, and AI use cases, partnering with product owners, architects, and data consumers.

You will implement end-to-end ETL/ELT workflows, develop Bronze-Silver-Gold data products, and ensure data quality, scalability, and reuse across teams.