Data Engineer

Stellantis NV; Auburn (AL); In loco; USD 120.000 - 180.000; Tempo pieno

Vantaggi offerti da questo lavoro

Company Vehicle Lease Program

Tuition reimbursement

18 paid volunteer hours per year

401k match

Descrizione del lavoro

Stellantis NV in Auburn, Alabama is seeking a Senior Data Engineer to design, build, and optimize robust data pipelines for batch and real-time processing. You will bridge software engineering and data science to ensure scalable, reliable data architectures.

You will lead pipeline development with Spark, manage cloud Infra with Terraform, and implement CI/CD using GitHub Actions, while upholding clean code and rigorous testing standards.

Competenze

• Minimum 5 years in data engineering & SDLC.
• 4+ years building production data applications.
• 4+ years with AWS cloud services.

Mansioni

• Pipeline Development: design and implement complex data processing pipelines using Apache Spark.
• Architectural Leadership: build scalable distributed systems for high-throughput data streams and batch processing.
• Infrastructure as Code: manage and provision cloud infrastructure using Terraform.
• CI/CD & Automation: implement GitHub Actions for automated testing and deployment.
• Code Quality: uphold rigorous software engineering standards with tests and documentation.
• Collaboration: translate business requirements into technical specs with stakeholders.

Conoscenze

Apache Spark

Python

Java

Scala

SQL

Airflow

Terraform

GitHub Actions

AWS

Azure

GCP

Kafka

Flink

Big Data

Time series

Distributed computing

Strumenti

Terraform

GitHub Actions

Spark

Cloud platforms (AWS/Azure/GCP)

Descrizione del lavoro

TheAI& DataAnalyticsTeam is looking for aSenior Data Engineerto join our team.In this role, you willbe responsible fordesigning, building, andoptimizingrobust data pipelines that process massive datasets in both batch and real-time.You will work at the intersection of software engineering and data science, ensuring that our data architecture is scalable, reliable, and follows industry best practices.

Priorities can change in a fast-paced environment like ours, so this role includes, but is not limited to, the following responsibilities:

• Pipeline Development: Design and implement complex data processing pipelines using Apache Spark.

• Architectural Leadership: Build scalable, distributed systems that handle high-throughput data streams and large-scale batch processing.

• Infrastructure as Code: Manage and provision cloud infrastructure using Terraform.

• CI/CD & Automation: Streamline development workflows by implementing andmaintainingGitHub Actions for automated testing and deployment.

• Code Quality: Uphold rigorous software engineering standards, including comprehensive unit/integration testing, code reviews, and maintainable documentation.

• Collaboration: Work closely with stakeholders to translate business requirements into technical specifications.

Basic Qualifications:

• A minimum of 5 years of experience in the data engineering and software development life cycle.Including:
  • A minimum of 4 years of hands-on experience in building andmaintainingproduction data applications, current experience in both relational and columnar data stores.
  • A minimum of 4 years of hands-on experience working with AWS cloud services

• Comprehensive experience with one or moreprogramminglanguages such asPython,Java,or Rust

• Comprehensiveexperience working with Big Data platforms (i.e., Spark, Google Big Query, Azure, AWS S3, etc.)

• Familiarity with time series database, data streaming applications,event driven architectures,Kafka, Flink, and more

• Experience with workflow management engines (i.e., Airflow, Luigi, Azure Data Factory, etc.)

• Experience with designing and implementing real-time pipelines

• Experience with data quality and validation

• Experience with API design

• Distributed Computing: Deepexpertisein Apache Spark (Core, SQL, and Structured Streaming).

• Programming Mastery: Strongproficiencyin Scala or Java. You should be comfortable building production-grade applications in a JVM-based environment.

• SQL Proficiency: Advanced knowledge of SQL for data transformation, analysis, and performance tuning.

• DevOps & Tools: Hands-on experience with Terraform for infrastructure management and GitHub Actions for CI/CD pipelines.

• Software Engineering Foundation: Solid understanding of data structures, algorithms, and design patterns. Experience applying "Clean Code" principles to data engineering.

• Stream Processing: Experience with Apache Flink for low-latency stream processing.

• Scripting:Proficiencyin Python for automation, data analysis, or scripting.

• Cloud Platforms: Experience with AWS, Azure, or GCP data services (e.g., EMR, Glue, Databricks).

• Data Modeling: Familiarity with dimensional modeling, Lakehouse architectures (Delta Lake, Iceberg), or NoSQL databases.

Preferred Qualifications:

• Comprehensive knowledge of relational database concepts,includingdata architecture, operational data stores, Interface processes,multidimensional modeling, master data management, and data manipulation

• Expert knowledge and experience with custom ETL design,implementationand maintenance

• Comprehensive experience designing, implementing, and iterating data pipelines using Big Data technologies

• Certification in AWS or other cloud providers

• Experience withDatabricks notebook workflows

• Experience withTerraform

Our Benefits — Designed with You in Mind

Comprehensive Health & Well-being Coverage

From your very first day, you'll have access to medical, dental, vision, and prescription drug coverage — ensuring you and your family stay healthy and protected.

Generous Paid Time Off

We believe in work-life balance. That's why we offer: 17+ paid holidays, including shut-down from December 24th through New Years Day every year. Vacation, float & wellbeing days, sick time and fully paid parental leave when your family needs you most.

Competitive Retirement Savings Plans

We help you plan for the future with:

• An employer match on contributions to your 401k, Roth, and Catch-Up plans
• An employer contribution, even if you don't contribute

Income Protection & Insurance Options

Benefit from included and optional disability, life, and other insurance programs — because your peace of mind matters.

Company Vehicle Lease Program

Eligible employees and their immediate families can enjoy company vehicle lease options with included insurance, maintenance, and unlimited mileage. Plus, take advantage of exclusive discounts on Stellantis products.

Family Building Benefit

We proudly support all paths to parenthood- including fertility and infertility treatments, adoption services, and gestational surrogacy.

Support for Your Growth and Giving Back

We believe in investing in your future and your passions:

• Tuition reimbursement
• Student loan refinancing programs
• 18 paid volunteer hours each year to make a difference in your community

And so much more!

When you join us, you're not just building a career — you're joining a company that supports you, inside and outside of work.