(Sr.) Data Engineer (m/f/d)

Personio; Berlin; Vor Ort; EUR 70.000 - 110.000; Vollzeit

Zusammenfassung

Smartbroker is seeking an experienced Data Engineer to advance its cloud-based data platform for business analytics and insights. You will build end-to-end data pipelines, ensure data quality, and collaborate with a team of data engineers and analysts to promote a data-driven culture.

The role emphasizes scalable pipelines, data modeling, and cloud technologies (AWS/GCP) with a strong emphasis on Python and SQL.

Qualifikationen

• University degree in computer science, mathematics, natural sciences, or a similar field.
• Several years of experience in data engineering building robust, scalable data pipelines.
• Experienced designing and operating pipelines on cloud platforms (AWS, GCP).

Aufgaben

• Develop and improve our cloud-based data platform for analytics and insights.
• Build end-to-end data pipelines from ingestion to consumable data.
• Implement data quality monitoring for reliable pipelines.
• Architect, code, and deploy data infrastructure components.
• Collaborate with data engineers and analysts across teams.

Kenntnisse

Data modeling

SQL

Python

Airflow

CI/CD

Data quality

Ausbildung

University degree in computer science, mathematics, natural sciences, or similar

Tools

dbt

Airflow

Kafka

Kinesis

Flink

S3

Athena

BigQuery

Jobbeschreibung

Your mission

Our significantly growing Data, AI & MarTech Department is looking for an experienced Data Engineer. The position is responsible for improving and continuously further developing our cloud-based data platform - the heart of Smartbroker's technical data infrastructure for business analytics & insights. Join us and play a major role in promoting and enabling a truly data-driven culture across the organisation! Job description:

• Develop and improve ourcloud baseddata platform for data analytic and business insights using most innovative data technologies
• Build end-to-end data pipelines from raw data ingestion to consumable data: prepare and clean structured and unstructured data and develop high-quality data models for advanced analytics and AI use cases
• Implement data quality monitoring to ensure accuracy and reliability of data pipelines
• Architect, code, and deploy data infrastructure components
• Collaborate closely withhighly ambitiousdata engineers and analysts in our growing Data, AI &MarTechDepartment as well as product technology colleagues
• Stay up to date with latest market developments in data cloud architecture and share your knowledge

Your profile

• University degree in computer science, mathematics, natural sciences, or a similar field
• Several years of experience in data engineering and strong know-how in building robust, scalable, and maintainable data pipelines and analytical data models
• Significant hands-on experience designing and operating data pipelines on cloud-based data platforms (AWS, GCP) using data-native services (S3, Athena, BigQuery…)
• Strong experience in data warehousing and analytics engineering, ideally including dbt and dimensional data modelling
• Excellent SQL skills and a deep understanding of data transformation, performance optimisation, and complex analytical queries
• Deep understanding of software engineering best practices: requirements specification, version control, CI/CD, testing, deployment, and monitoring of data pipelines and transformations
• Strong programming skills in Python, ideally including orchestration frameworks such as Airflow
• Experience with data quality, observability, and testing approaches to deliver reliable and trusted data products
• Knowledge of data streaming technologies like Kafka, Kinesis, Flink and cloud infrastructure is a plus
• Excellent English communication skills, German is a plus
• Interest in finance and fintech industry and a sense of humor