AWS Data Engineer - (German speaking)

Empiric; Düsseldorf; Vor Ort; EUR 55.000 - 85.000; Vollzeit

Zusammenfassung

An established industry player is seeking a skilled Data Engineer to join their innovative team. In this role, you will develop and optimize data pipelines using cutting-edge AWS technologies, including Glue and Lambda functions. You will leverage your Python expertise to create reusable modules and APIs while leading project teams in designing comprehensive ETL workflows. If you are passionate about data engineering and thrive in a collaborative environment, this opportunity offers you the chance to make a significant impact on data transformation initiatives. Join a dynamic team where your skills will be valued and your contributions will drive success.

Qualifikationen

• 5+ years of experience in Data Engineering focusing on cloud solutions.
• Strong expertise in AWS services and Python development.

Aufgaben

• Develop and optimize data pipelines using AWS Glue and Lambda functions.
• Lead project teams in designing end-to-end data pipelines and ETL workflows.

Kenntnisse

Python

AWS Glue

ETL workflows

Fast API

Flask

Django

Data Processing

Data Transformation

Data Migration

DevOps

Ausbildung

Bachelor’s degree in Computer Science

Bachelor’s degree in Information Technology

Tools

AWS S3

AWS Lambda

AWS Kinesis

Python Notebooks

Jobbeschreibung

• Develop and optimize data pipelines using AWS Glue and Lambda functions.
• Utilize Python to build reusable modules, APIs (Fast API / Flask / Django), and automation scripts.
• Lead project teams in designing end-to-end data pipelines and ETL workflows.
• Troubleshoot data processing issues and optimize performance for ETL workflows. Experiences :
• Experienced in working with Python projects for Data Processing, Data Transformation, and building reusable and modular components. Experience in Data Migration is a plus.
• Experienced in both classical Python development as well as in Python Notebooks.
• Experienced in AWS components such as S3, Glue, Lambda, and Kinesis (KDS)
• Experienced with DevOps and Infrastructure oversight.

Required Qualifications :

• 5+ years of experience in Data Engineering with a focus on cloud-based solutions.
• Strong expertise in AWS services like S3, Glue, Lambda, and IAM configurations.
• Bachelor’s degree in Computer Science, Information Technology, or related fields.

Soft Skills :

• Excellent problem-solving skills with a collaborative mindset.
• Strong leadership and communication skills for working with cross-functional teams.
• Ability to manage multiple tasks, prioritize effectively, and deliver high-quality results."