Senior Data Engineer — Real-Time Pipelines & Cloud Infra

Stellantis; Auburn Hills (MI); On-site; USD 120,000 - 180,000; Full time

Job summary

Stellantis is seeking a Senior Data Engineer to design, build, and optimize robust data pipelines for massive datasets in batch and real-time modes. You will operate at the intersection of software engineering and data science to ensure scalable and reliable data architectures that follow industry best practices.

Responsibilities include designing Spark-based pipelines, building distributed systems, and managing cloud infrastructure with Terraform.

Qualifications

• Bachelor's degree in Computer Science, Engineering, Mathematics, or related technical discipline.
• Minimum 5 years in data engineering and SDLC.
• At least 4 years building/maintaining production data applications with relational and columnar stores.
• At least 4 years working with AWS cloud services.
• Proficiency in Python, Java, or Scala.
• Experience with Spark, BigQuery, AWS S3, Azure, etc.
• Familiarity with Kafka, Flink, and event-driven architectures.
• Experience with Airflow, Luigi, Azure Data Factory, etc.
• Experience designing real-time pipelines and data quality validation.
• Strong SQL for data transformation and performance tuning.
• Terraform for infrastructure and GitHub Actions for CI/CD.
• Knowledge of Clean Code practices in data engineering.
• Experience with Flink for low-latency stream processing.
• Python scripting for automation.

Responsibilities

• Design and implement complex data processing pipelines using Apache Spark.
• Build scalable, distributed systems for high-throughput data streams and batch processing.
• Manage cloud infrastructure using Terraform.
• Streamline development workflows with GitHub Actions for testing and deployment.
• Maintain code quality through unit/integration testing and reviews.
• Collaborate with stakeholders to translate business requirements into technical specs.

Skills

Apache Spark

Python

Java/Scala

AWS Cloud

SQL Proficiency

Kafka / Flink

Airflow

Terraform

DevOps CI/CD

Education

Bachelors degree in Computer Science or related field

Tools

Databricks

GitHub Actions

S3 / AWS tooling

Job description

Stellantis is seeking a Senior Data Engineer to design, build, and optimize robust data pipelines for massive datasets in batch and real-time modes. You will operate at the intersection of software engineering and data science to ensure scalable and reliable data architectures that follow industry best practices.

Responsibilities include designing Spark-based pipelines, building distributed systems, and managing cloud infrastructure with Terraform.