Data engineer

Meridian Personal; Berlin; In loco; EUR 70.000 - 110.000; Tempo pieno

Descrizione del lavoro

Meridian Personal ищет для клиента инновационную технологическую компанию в области анализа данных и цифровых бизнес-моделей Data Engineer в Берлине на полную ставку. Вы будете строить и разворачивать масштабируемые дата-платформы, интегрировать данные и поддерживать аналитику и машинное обучение.

Кандидат должен иметь сильное владение SQL и Python, опыт ETL/ELT, работе с облачными сервисами AWS/Azure/GCP и современными хранилищами данных.

Competenze

• Степень по информатике/BI/DS или эквивалентная квалификация.
• Несколько лет опыта в data engineering и создании современных data платформ.
• Сильные знания SQL и Python, ETL/ELT, данные в облаке.
• Опыт работы с DWH/хранилищами и моделированием данных.
• Опыт работы с Git, CI/CD и тестированием.

Mansioni

• Проектирование, разработку и эксплуатацию масштабируемых конвейеров данных.
• Интеграцию структурированных/неструктурированных данных из разных источников.
• Разработку ETL/ELT процессов для надежного предоставления данных.
• Создание и развитие современных хранилищ данных и data lakes.
• Обеспечение качества и доступности данных, мониторинг процессов.

Conoscenze

SQL

Python

ETL/ELT

DWH/Databricks

CI/CD

Git

Cloud platforms

Data modeling

Data quality

English

Formazione

Высшее образование в информатике/BI/DS

Strumenti

Snowflake/Databricks

BigQuery

Docker

Infra as Code

Airflow

Apache Spark

dbt

Descrizione del lavoro

Описание:

For our client, an innovative technology company in data analytics and digital business models, we are seeking a Data Engineer (m/f/d) for a full-time position in Berlin, starting as soon as possible. The company helps its clients optimize data-driven business processes and make well-founded decisions based on modern data architectures. In this role, you will play a key part in building, operating and further developing high-performance data platforms. You will design scalable data pipelines, integrate data from various source systems and provide the technical foundation for analytics, reporting and machine learning applications.

Задачи:

• Designing, developing and operating scalable data pipelines for processing large volumes of data
• Integrating and preparing structured and unstructured data from various source systems
• Developing and optimizing ETL and ELT processes for reliable data provision
• Building and further developing modern data warehouses and data lakes
• Modeling and transforming data for analytics, reporting and business intelligence applications
• Developing and maintaining automated data processing workflows with Python and SQL
• Implementing and optimizing data architectures based on modern cloud platforms
• Ensuring data quality, data consistency and data availability through appropriate validation and monitoring processes
• Optimizing existing data pipelines for performance, scalability and maintainability
• Collaborating with data scientists, data analysts and business units to provide suitable data foundations
• Implementing security, data protection and governance requirements within the data infrastructure
• Documenting data models, interfaces and technical processes
• Actively contributing to the further development of the data platform and to digitalization and automation projects

Требования:

• Successfully completed degree in computer science, business informatics, data science or a comparable qualification
• Several years of professional experience in data engineering, data integration or building modern data platforms
• Strong knowledge of SQL and practical experience developing with Python
• Experience with ETL and ELT processes and integrating various data sources
• Good knowledge of relational databases and modern data warehouse technologies
• Experience with cloud platforms such as AWS, Microsoft Azure or Google Cloud Platform
• Understanding of data modeling, data quality and scalable data architectures
• Experience with Git, automated testing and modern CI/CD processes
• Structured, analytical and solution-oriented approach to work
• Strong commitment to quality and an interest in modern data architectures and data-driven business models
• Team player with strong communication skills when working with technical and business stakeholders
• Very good German and English skills
• Будет плюсом: Knowledge of technologies such as Apache Spark, Apache Airflow or dbt is an advantage; Ideally, practical experience with Snowflake, Databricks, BigQuery or comparable data platforms; Knowledge of Docker and Infrastructure as Code is desirable

Условия:

• Permanent position at an innovative, growth-oriented technology company
• Responsible role with a high degree of independence and technical freedom to shape solutions
• Work on modern data platforms and challenging data projects
• Use of current cloud technologies and scalable data architectures
• Opportunity to actively shape data models, pipelines and technical standards
• Modern working environment with agile development processes and short decision-making paths
• Close collaboration with data scientists, data analysts and software developers
• Freedom to help select and further develop suitable technologies
• Individual training and development opportunities in data engineering and cloud computing
• Long-term prospects in a forward-looking market environment
• Attractive location in Berlin with good access to the digital business and technology scene