Senior Data Engineer – IoT & Real-Time Analytics

General Motors Corporation; Austin, Northern (TX, KY); Hybrid; USD 125,000 - 169,000; Full time

Benefits offered by this job

Health insurance

Relocation benefits

Job summary

General Motors Corporation seeks a Senior Data Engineer to build and optimize cloud data warehouse solutions for IoT data leveraging Databricks, Snowflake, and Apache Iceberg. You will design ODS speed layers, ensuring near real-time analytics and scalable BI support.

You will collaborate across teams to translate requirements into robust data pipelines, while prioritizing data quality, security, and cost efficiency in a hybrid Austin-based role.

Qualifications

• Bachelor’s degree in software engineering, Computer Science, Information Technology, or related field.
• 7+ years experience designing, developing, and supporting enterprise applications.
• Proven in implementing cloud data warehouses using Databricks, Snowflake or any other data platform.
• Hands-on experience with Apache Flink or Spark for data lake pipelines.
• Experience designing and building Operational Data Stores (ODS) as speed layers for analytic environments.
• Experience with IoT data ingestion, processing, and analytics.
• Strong proficiency in SQL, Python, Java and ETL tools.
• Proven cloud experience and strong familiarity with at least one cloud platform (Microsoft Azure - preferred, AWS, GCP).
• Experienced in proactive issue detection leveraging anomaly detection techniques, with a strong focus on monitoring pipeline performance, ensuring system reliability, and identifying bottlenecks through observability metrics.
• Good understanding and experience with CI/CD practices.

Responsibilities

• Develop cloud data warehouse solutions leveraging Databricks and Kubernetes.
• Implement robust data pipelines to ingest, process, and store IoT data from diverse sources.
• Integrate and manage large-scale datasets using Apache Iceberg for efficient, reliable, and scalable data lake operations.
• Build an Operational Data Store (ODS) to function as a speed layer, enabling rapid access for near real‑time use cases.
• Collaborate with data engineers, analysts, and business stakeholders to understand requirements and deliver scalable solutions.
• Optimize data models, storage, and compute resources for performance and cost efficiency.
• Ensure data quality, security, and compliance across all cloud data platforms.
• Setting up monitoring tools and dashboards to track pipeline health, diagnose issues, and optimize performance.
• Stay current with industry trends and best practices in data management, ODS technologies, and API development.

Skills

Cloud data warehouse design

SQL

Python

Java

ETL

Databricks

Snowflake

Apache Flink

Kubernetes

IoT data ingestion

Education

Bachelor’s in Software Engineering / Computer Science / IT or related field

Tools

Databricks platform

Snowflake

Apache Iceberg

Kubernetes

CI/CD tools

Job description

General Motors Corporation seeks a Senior Data Engineer to build and optimize cloud data warehouse solutions for IoT data leveraging Databricks, Snowflake, and Apache Iceberg. You will design ODS speed layers, ensuring near real-time analytics and scalable BI support.

You will collaborate across teams to translate requirements into robust data pipelines, while prioritizing data quality, security, and cost efficiency in a hybrid Austin-based role.