Senior data engineer

TestYantra Software Solutions; München; Vor Ort; EUR 40.000 - 60.000; Vollzeit

Zusammenfassung

A leading tech company in Bayern, München is seeking a Senior Data Engineer to develop and optimize data solutions in the automotive domain. This role involves designing pipelines, enhancing data lakes, and utilizing AWS tools for analytics. The ideal candidate has extensive experience in data engineering, strong Python programming skills, and a good understanding of software architecture. A collaborative environment awaits where innovative data-driven solutions thrive.

Qualifikationen

• 5+ years of hands-on experience with data engineering projects in AWS.
• Strong grasp of software engineering best practices.
• Excellent communication skills in English, German a plus.

Aufgaben

• Design and implement robust, production-ready data solutions for the automotive domain.
• Enhance the existing data lake and architecture for a future AWS-based data warehouse.
• Develop and maintain batch and streaming data pipelines on AWS.

Kenntnisse

Python programming

Data engineering in AWS

ETL process optimization

SQL proficiency

Data modeling

Apache Spark

Kinesis

GitLab CI/CD

Docker

Version control

Ausbildung

BSc/MSc in Computer Science, Engineering, Mathematics, or related field

Tools

AWS Glue

Athena

RDS

Apache Iceberg

Terraform

Django

Jobbeschreibung

Overview

Job Description: Senior Data Engineer

As a Senior Data Engineer, you will play a key role in the development, expansion, and operation of our corporate data lake. You will be responsible for designing and implementing scalable data pipelines, optimizing data architecture, and ensuring the reliability and performance of our data infrastructure. Your expertise will help shape the foundation for data-driven innovation across the organization. We are looking for a seasoned professional with deep experience in cloud-based data engineering and a passion for enabling advanced analytics at scale.

Responsibilities

• Design and implement robust, production-ready data solutions tailored to the automotive domain
• Enhance the existing Brose Data Lake and contribute to the architecture of a future AWS-based data warehouse
• Develop and maintain batch and streaming data pipelines on AWS
• Review and optimize ETL processes with a focus on data quality, consistency, and monitoring
• Translate business requirements into efficient relational data models
• Collaborate closely with data scientists to deliver scalable, end-to-end analytics solutions

Qualifications

• BSc/MSc in Computer Science, Engineering, Mathematics, Physics, or a related field—or equivalent professional experience
• Strong programming skills in Python and a solid understanding of software architecture
• 5+ years of hands-on experience with data engineering projects in an AWS environment
• Proficiency with tools such as Apache Spark (batch and streaming), Kinesis (Firehose and Streams), AWS Glue (Jobs and Crawlers), Athena, Lambda, and RDS
• Solid SQL skills and experience with dimensional data modeling for data warehouses
• Familiarity with GitLab CI/CD pipelines and Docker; experience with Apache Iceberg, Terraform, or Django is a plus
• Strong grasp of software engineering best practices, including version control, clean code, code reviews, testing, and automation
• Pragmatic, structured, and solution-oriented approach to problem-solving
• Excellent communication skills in English; German proficiency is a plus