(Senior) Data Engineer (m/w/d)

Characters Recruiting; Köln; Vor Ort; EUR 60.000 - 80.000; Vollzeit

Zusammenfassung

A leading company in its sector is seeking a (Senior) Data Engineer to enhance its business intelligence capabilities and big data solutions. The role involves designing data models, migrating data warehouses to the AWS cloud, and optimizing data quality. Ideal candidates have extensive experience with AWS technologies and programming skills in Python and Spark.

Qualifikationen

• At least 3 years of experience in a similar position working with big data.
• Hands-on experience with cloud-based databases and processes.
• Very good programming skills in Python and Spark.

Aufgaben

• Develop business intelligence structures and data models.
• Support end-to-end Big Data solutions for business units.
• Migrate BI data warehouse from Oracle to PostgreSQL in AWS.

Kenntnisse

Big Data

Data Modeling

SQL

Python

Spark

AWS

Tools

AWS Glue

AWS Lambda

Git

IntelliJ

Spring

Maven

Docker

Jobbeschreibung

For our client, a leading company in its sector, we are searching for a (Senior) Data Engineer (m/w/d) as soon as possible.

Your job

• Through your active participation in the further development of business intelligence structures and data models, you will help to shape the future
• You will support the development of end-to-end Big Data solutions for the various business units using the broad range of technologies in the BI department.
• You will design and implement data models, data flows, and APIs to enable high-performance Big Data usage
• You take a central role in migrating the BI data warehouse from Oracle to a PostgreSQL database in the AWS cloud
• You are a part of the whole, working independently and intensively with experienced colleagues
• You think holistically - you continuously analyze and optimize data bases in terms of data quality and from the perspective of the requirements of the business department
• You set new standards with your own ideas, innovative solutions and standards.

Your profile

• At least 3 years of experience in a similar position working with big data
• Hands-on experience with cloud based databases and processes, as well as AWS Glue, Lambda, or similar technologies
• Knowledge of data modeling and in optimizing ETL processes.
• Touch points with evaluating and building relational databases
• Very good knowledge of the SQL database language
• Very good programming skills in Python and Spark
• You are no stranger to various data storage technologies (e.g., AWS S3, PostgreSQL, MongoDB
• Understanding of software technologies and frameworks such as, Git, IntelliJ, Spring, Maven, Docker

Interested yet? Feel free to send us your application letter!