Senior Data Engineer - Real-Time Pipelines & Cloud Infra

Stellantis NV; Auburn (AL); In loco; USD 120.000 - 180.000; Tempo pieno

Vantaggi offerti da questo lavoro

Company Vehicle Lease Program

Tuition reimbursement

18 paid volunteer hours per year

401k match

Descrizione del lavoro

Stellantis NV in Auburn, Alabama is seeking a Senior Data Engineer to design, build, and optimize robust data pipelines for batch and real-time processing. You will bridge software engineering and data science to ensure scalable, reliable data architectures.

You will lead pipeline development with Spark, manage cloud Infra with Terraform, and implement CI/CD using GitHub Actions, while upholding clean code and rigorous testing standards.

Competenze

• Minimum 5 years in data engineering & SDLC.
• 4+ years building production data applications.
• 4+ years with AWS cloud services.

Mansioni

• Pipeline Development: design and implement complex data processing pipelines using Apache Spark.
• Architectural Leadership: build scalable distributed systems for high-throughput data streams and batch processing.
• Infrastructure as Code: manage and provision cloud infrastructure using Terraform.
• CI/CD & Automation: implement GitHub Actions for automated testing and deployment.
• Code Quality: uphold rigorous software engineering standards with tests and documentation.
• Collaboration: translate business requirements into technical specs with stakeholders.

Conoscenze

Apache Spark

Python

Java

Scala

SQL

Airflow

Terraform

GitHub Actions

AWS

Azure

GCP

Kafka

Flink

Big Data

Time series

Distributed computing

Strumenti

Terraform

GitHub Actions

Spark

Cloud platforms (AWS/Azure/GCP)

Descrizione del lavoro

Stellantis NV in Auburn, Alabama is seeking a Senior Data Engineer to design, build, and optimize robust data pipelines for batch and real-time processing. You will bridge software engineering and data science to ensure scalable, reliable data architectures.

You will lead pipeline development with Spark, manage cloud Infra with Terraform, and implement CI/CD using GitHub Actions, while upholding clean code and rigorous testing standards.