Senior Cloud Data Engineer - IoT & DW (Hybrid)

General Motors; Austin (TX); Híbrido; USD 125 000 - 169 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Health insurance

Retirement plan

Paid vacation & holidays

GM vehicle discounts

Resumo da oferta

General Motors in Austin seeks an experienced Data Engineer to design and implement cloud data warehouse solutions. You will ingest IoT data, build scalable pipelines using Databricks, Snowflake, Flink/Spark, and design an Operational Data Store for fast analytics.

The role emphasizes data quality, security, and observability, with a hybrid schedule and collaboration with cross-functional teams across the GM Energy Data Engineering group.

Qualificações

• Bachelor's degree in software engineering, CS, IT, or related field.
• 7+ years experience designing, developing, and supporting enterprise applications.
• Proven in implementing cloud data warehouses using Databricks, Snowflake or similar.
• Hands-on experience with Apache Flink or Spark for data lake pipelines.
• Experience designing and building Operational Data Stores (ODS) as speed layers for analytics.
• Experience with IoT data ingestion, processing, and analytics.
• Strong proficiency in SQL, Python, Java and ETL tools.
• Proven cloud experience with at least one cloud platform (Azure preferred, AWS, GCP).
• Experience with CI/CD practices and observability for performance monitoring.

Responsabilidades

• Develop cloud data warehouse solutions leveraging Databricks and Kubernetes.
• Implement robust data pipelines to ingest, process, and store IoT data from diverse sources.
• Integrate and manage large-scale datasets using Apache Iceberg for efficient data lake operations.
• Build an Operational Data Store (ODS) to enable near real-time analytics.
• Collaborate with data engineers, analysts, and stakeholders to deliver scalable solutions.
• Optimize data models, storage, and compute resources for performance and cost efficiency.
• Ensure data quality, security, and compliance across cloud data platforms.
• Set up monitoring tools and dashboards to track pipeline health and performance.
• Stay current with industry trends in data management, ODS tech, and API development.

Conhecimentos

Cloud Data Warehouse

Databricks

Snowflake

Apache Flink

Spark

IoT data ingest

SQL

Python

Java

ETL tools

CI/CD

Formação académica

Bachelor's degree in CS/SE

Ferramentas

Databricks platform

Snowflake

Kubernetes

Apache Iceberg

Azure/AWS/GCP

Descrição da oferta de emprego

General Motors in Austin seeks an experienced Data Engineer to design and implement cloud data warehouse solutions. You will ingest IoT data, build scalable pipelines using Databricks, Snowflake, Flink/Spark, and design an Operational Data Store for fast analytics.

The role emphasizes data quality, security, and observability, with a hybrid schedule and collaboration with cross-functional teams across the GM Energy Data Engineering group.