Senior Data Engineer

Devop.One; Berlin; Vor Ort; EUR 55.000 - 75.000; Vollzeit

Zusammenfassung

A technology firm in Berlin is seeking an experienced data processing engineer to independently design, implement, and operate data processing pipelines. This role involves ensuring data quality, developing scalable architectures, and working closely with engineers and analysts. Candidates should have several years of experience in cloud application development and agile environments, with a focus on data quality and machine learning methods. Join a dynamic team and contribute to innovative data solutions.

Qualifikationen

• Several years of experience in the development of cloud-based applications.
• Several years of experience as a software developer or comparable position.
• Several years of experience in the area of agile software development.

Aufgaben

• Monitoring and ensuring data quality and processing performance.
• Conception, implementation, and testing of scalable data processing architectures.
• Evaluation and analysis of complex data sets for infrastructure optimization.

Kenntnisse

Data quality assurance

Data processing architecture

Machine learning methods

Agile software development

Jobbeschreibung

Goal: Independent conception, implementation and operation of data processing pipelines for the provision and preparation of mass data. Ensuring data quality and data availability.

Services & Responsibilities

• Monitoring and ensuring data quality, data availability and processing performance
• Provision of interfaces for data exchange
• Conception, implementation and testing of scalable data processing architectures
• Conception, implementation and testing of ETL processes in coordination with data scientists and business analysts
• Close coordination with front-end, back-end engineers, product managers and analysts
• Application and provision of machine learning and statistical methods for evaluating and predicting patterns in the data
• Continuous coordination and proactive communication with data protection functions
• Evaluation and analysis of data sets of various complexity and the development and optimization of the data processing infrastructure based on them
• Development of solution options in order to get from the actual to the target state as well as evaluation and presentation of the solution options

Experience

• Several years of experience in the development of cloud-based applications
• Several years of experience as a software developer or comparable position
• Several years of experience in the area of agile software development