AWS Data Engineer - (German speaking)

Empiric; Köln; Vor Ort; EUR 60.000 - 90.000; Vollzeit

Zusammenfassung

An established industry player is seeking a skilled Data Engineer to develop and optimize data pipelines using cutting-edge AWS technologies. In this dynamic role, you will lead project teams in designing end-to-end data pipelines and ETL workflows, utilizing Python to create reusable modules and APIs. Your expertise in AWS services like Glue, Lambda, and S3 will be crucial as you troubleshoot data processing issues and enhance performance. If you are passionate about data engineering and thrive in collaborative environments, this opportunity is perfect for you to make a significant impact.

Qualifikationen

• 5+ years of experience in Data Engineering with cloud-based solutions.
• Strong expertise in AWS services like S3, Glue, and Lambda.

Aufgaben

• Develop and optimize data pipelines using AWS Glue and Lambda functions.
• Lead project teams in designing end-to-end data pipelines and ETL workflows.

Kenntnisse

Python

AWS Glue

ETL workflows

Fast API

Flask

Django

Data Migration

DevOps

Ausbildung

Bachelor's degree in Computer Science

Tools

AWS S3

AWS Lambda

AWS Kinesis

Jobbeschreibung

• Develop and optimize data pipelines using AWS Glue and Lambda functions.
• Utilize Python to build reusable modules, APIs (Fast API / Flask / Django), and automation scripts.
• Lead project teams in designing end-to-end data pipelines and ETL workflows.
• Troubleshoot data processing issues and optimize performance for ETL workflows. Experiences :
• Experienced in working with Python projects for Data Processing, Data Transformation, and building reusable and modular components. Experience in Data Migration is a plus.
• Experienced in both classical Python development as well as in Python Notebooks.
• Experienced in AWS components such as S3, Glue, Lambda, and Kinesis (KDS)
• Experienced with DevOps and Infrastructure oversight.

Required Qualifications :

• 5+ years of experience in Data Engineering with a focus on cloud-based solutions.
• Strong expertise in AWS services like S3, Glue, Lambda, and IAM configurations.
• Bachelor’s degree in Computer Science, Information Technology, or related fields.

Soft Skills :

• Excellent problem-solving skills with a collaborative mindset.
• Strong leadership and communication skills for working with cross-functional teams.
• Ability to manage multiple tasks, prioritize effectively, and deliver high-quality results."