Senior Data Engineer

General Motors Corporation; Austin, Northern (TX, KY); Hybrid; USD 125,000 - 169,000; Full time

Benefits offered by this job

Health insurance

Relocation benefits

Job summary

General Motors Corporation seeks a Senior Data Engineer to build and optimize cloud data warehouse solutions for IoT data leveraging Databricks, Snowflake, and Apache Iceberg. You will design ODS speed layers, ensuring near real-time analytics and scalable BI support.

You will collaborate across teams to translate requirements into robust data pipelines, while prioritizing data quality, security, and cost efficiency in a hybrid Austin-based role.

Qualifications

• Bachelor’s degree in software engineering, Computer Science, Information Technology, or related field.
• 7+ years experience designing, developing, and supporting enterprise applications.
• Proven in implementing cloud data warehouses using Databricks, Snowflake or any other data platform.
• Hands-on experience with Apache Flink or Spark for data lake pipelines.
• Experience designing and building Operational Data Stores (ODS) as speed layers for analytic environments.
• Experience with IoT data ingestion, processing, and analytics.
• Strong proficiency in SQL, Python, Java and ETL tools.
• Proven cloud experience and strong familiarity with at least one cloud platform (Microsoft Azure - preferred, AWS, GCP).
• Experienced in proactive issue detection leveraging anomaly detection techniques, with a strong focus on monitoring pipeline performance, ensuring system reliability, and identifying bottlenecks through observability metrics.
• Good understanding and experience with CI/CD practices.

Responsibilities

• Develop cloud data warehouse solutions leveraging Databricks and Kubernetes.
• Implement robust data pipelines to ingest, process, and store IoT data from diverse sources.
• Integrate and manage large-scale datasets using Apache Iceberg for efficient, reliable, and scalable data lake operations.
• Build an Operational Data Store (ODS) to function as a speed layer, enabling rapid access for near real‑time use cases.
• Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver scalable solutions.
• Optimize data models, storage, and compute resources for performance and cost efficiency.
• Ensure data quality, security, and compliance across all cloud data platforms.
• Setting up monitoring tools and dashboards to track pipeline health, diagnose issues, and optimize performance.
• Stay current with industry trends and best practices in data management, ODS technologies, and API development.

Skills

Cloud data warehouse design

SQL

Python

Java

ETL

Databricks

Snowflake

Apache Flink

Kubernetes

IoT data ingestion

Education

Bachelor’s in Software Engineering / Computer Science / IT or related field

Tools

Databricks platform

Snowflake

Apache Iceberg

Kubernetes

CI/CD tools

Job description

## Senior Data EngineerApply: Hybrid: Austin, Texas, United States of America: Full time: Posted Today: JR-202621034**Job Description****This role is categorized as hybrid. This means the successful candidate is expected to report to Austin Technical Center three times per week, at minimum [or other frequency dictated by the business if more than 3 days].** **The Role** The GM Energy Data Engineering team is on the lookout for a talented Data Engineer who is a highly skilled and hands-on Cloud Data Warehouse engineer with experience in IoT data integration, Snowflake, Databricks, and Apache Flink. The selected candidate will play a pivotal role in designing, implementing, and optimizing scalable cloud-based data warehouse solutions, including an Operational Data Store (ODS) to serve as a speed layer for advanced analytics and business intelligence initiatives.## **What You’ll Do** * Develop cloud data warehouse solutions leveraging Databricks and Kubernetes.* Implement robust data pipelines to ingest, process, and store IoT data from diverse sources.* Integrate and manage large-scale datasets using Apache Iceberg for efficient, reliable, and scalable data lake operations.* Build an Operational Data Store (ODS) to function as a speed layer, enabling rapid access for near real-time use Cases.* Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver scalable solutions.* Optimize data models, storage, and compute resources for performance and cost efficiency.* Ensure data quality, security, and compliance across all cloud data platforms.* Setting up monitoring tools and dashboards to track pipeline health, diagnose issues, and optimize performance.* Stay current with industry trends and best practices in data management, ODS technologies, and API development.## **Your Skills & Abilities (Required Qualifications)** * Bachelor’s in software engineering, Computer Science, Information Technology, or a related field or equivalent experience.* 7+ years experience designing, developing, and supporting enterprise applications.* Proven in implementing cloud data warehouses using Databricks, Snowflake or any other data platform.* Hands-on experience with Apache Flink or Spark for data lake pipelines.* Experience designing and building Operational Data Stores (ODS) as speed layers for analytic environments.* Experience with IoT data ingestion, processing, and analytics.* Strong proficiency in SQL, Python, Java and ETL tools.* Proven cloud experience and strong familiarity with at least one cloud platform (Microsoft Azure - preferred, AWS, GCP).* Experienced in proactive issue detection leveraging anomaly detection techniques, with a strong focus on monitoring pipeline performance, ensuring system reliability, and identifying bottlenecks through observability metrics.* Good understanding and experience with CI/CD practices.## ## **What Can Give You a Competitive Advantage (Preferred Qualifications)*** Experience with Databricks platform and Databricks certifications.* Experience with real-time data streaming technologies (e.g., Kafka, Spark Streaming, Flink).* Knowledge of data governance and security best practices.* OCPP Protocol expertiseThis job may be eligible for relocation benefits. **Compensation:*** The expected base compensation for this role is: $125,000 - $168,650. Actual base compensation within the identified range will vary based on factors relevant to the position.* Bonus Potential: An incentive pay program offers payouts based on company performance, job level, and individual performance.* Benefits: GM offers a variety of health and wellbeing benefit programs. Benefit options include medical, dental, vision, Health Savings Account, Flexible Spending Accounts, retirement savings plan, sickness and accident benefits, life insurance, paid vacation & holidays, tuition assistance programs, employee assistance program, GM vehicle discounts and more. GM DOES NOT PROVIDE IMMIGRATION-RELATED SPONSORSHIP FOR THIS ROLE. DO NOT APPLY FOR THIS ROLE IF YOU WILL NEED GM IMMIGRATION SPONSORSHIP NOW OR IN THE FUTURE. THIS INCLUDES DIRECT COMPANY SPONSORSHIP, ENTRY OF GM AS THE IMMIGRATION EMPLOYER OF RECORD ON A GOVERNMENT FORM, AND ANY WORK AUTHORIZATION REQUIRING A WRITTEN SUBMISSION OR OTHER IMMIGRATION SUPPORT FROM THE COMPANY (e.g., H-1B, OPT, STEM OPT, CPT, TN, J-1, etc.)