Senior Data Engineer - IoT, Streaming & Azure

General Motors; Austin (TX); Hybride; USD 125 000 - 169 000; Plein temps

Avantages offerts par ce poste

Relocation benefits

Résumé du poste

General Motors in Austin is seeking a hands-on Data Engineer to design, implement, and optimize cloud data warehouse solutions. The role focuses on IoT data integration, real-time streaming, and scalable analytics in a hybrid work setting.

You will work with Java services, Databricks, Flink, GraphQL, and PostgreSQL, deploying on Azure, building CI/CD pipelines, and mentoring peers while shaping architecture and engineering standards.

Qualifications

• 7+ years of professional software development experience.
• Strong proficiency in Java and object-oriented design.
• Experience building production‑grade backend services and distributed systems.
• Hands‑on experience with one or more streaming technologies, preferably Apache Flink, Apache Pulsar, and Apache Kafka.
• Strong understanding of event‑driven architecture, messaging patterns, data partitioning, consumer groups, delivery semantics, and stream processing.
• Experience designing and developing GraphQL APIs.
• Strong experience with PostgreSQL, including schema design, SQL, performance tuning, indexing, and transaction management.
• Experience with Databricks and data engineering or analytics platforms.
• Experience developing and deploying applications in Microsoft Azure.
• Practical CI/CD experience with automated testing, packaging, deployment, and release management.
• Experience with source control and collaborative development workflows, such as Git and pull requests.
• Strong troubleshooting, communication, and technical documentation skills.

Responsabilités

• Design, develop, test, and maintain scalable Java services and distributed applications.
• Build and optimize real-time data streaming pipelines using Apache Flink, Apache Pulsar, and Apache Kafka.
• Develop reliable event-driven services with strong attention to throughput, latency, resiliency, ordering, replay, and fault tolerance.
• Design and implement an Operational Data Store (ODS) layer using GraphQL and PostgreSQL.
• Develop GraphQL APIs and services that provide secure, efficient, and well‑structured access to operational data.
• Design relational schemas, queries, indexes, and data‑access patterns for PostgreSQL.
• Integrate streaming and operational data services with Databricks and cloud‑based data platforms.
• Deploy and operate applications in Microsoft Azure using cloud‑native architecture and services.
• Implement automated build, test, deployment, and release processes through CI/CD pipelines.
• Apply software engineering best practices, including code reviews, automated testing, observability, documentation, and secure development.
• Troubleshoot complex issues across application, streaming, database, and cloud environments.
• Participate in technical design discussions and contribute to architecture decisions.
• Mentor other engineers and help establish engineering standards and reusable patterns.
• Use generative AI tools and effective prompting techniques to accelerate development, troubleshoot issues, create documentation, and improve engineering productivity while applying appropriate security and data‑handling practices.

Connaissances

Java

Distributed systems

Cloud data warehouse

PostgreSQL

Databricks

Apache Flink

GraphQL APIs

Azure

CI/CD

Pulsar

Kafka

Outils

Databricks

PostgreSQL

Azure

Kafka

Flink

Pulsar

GraphQL

Description du poste

General Motors in Austin is seeking a hands-on Data Engineer to design, implement, and optimize cloud data warehouse solutions. The role focuses on IoT data integration, real-time streaming, and scalable analytics in a hybrid work setting.

You will work with Java services, Databricks, Flink, GraphQL, and PostgreSQL, deploying on Azure, building CI/CD pipelines, and mentoring peers while shaping architecture and engineering standards.