(Sr.) Data Engineer (m/f/d)

Smartbroker AG; Berlin; Sur place; EUR 75 000 - 110 000; Plein temps

Résumé du poste

Smartbroker AG is seeking an experienced Data Engineer to enhance our cloud-based data platform, the core of our analytics infrastructure. You will help promote a data-driven culture by building robust pipelines and data models.

You will work with a team of ambitious data engineers and analysts on AWS/GCP environments, leverage tools like S3, Athena and BigQuery, and stay up to date with cloud data architecture trends.

Qualifications

• University degree in computer science, mathematics, natural sciences, or a similar field.
• Several years of experience in data engineering and building scalable data pipelines.
• Experience designing data models and analytical data platforms on cloud services (AWS or GCP).
• Strong SQL skills and knowledge of data transformation and performance optimization.
• Familiarity with data quality, observability and testing approaches.

Responsabilités

• Develop and improve our cloud-based data platform for analytics and AI use cases.
• Build end-to-end data pipelines from ingestion to consumable data.
• Prepare and clean structured and unstructured data for high-quality models.
• Implement data quality monitoring for reliability of pipelines.
• Architect, code, and deploy data infrastructure components.
• Collaborate with data engineers, analysts and product tech colleagues.

Connaissances

Python

SQL

Airflow

ETL pipelines

AWS

GCP

dbt

Kafka

Kinesis

Flink

Data modeling

English

Formation

University degree in computer science, mathematics, natural sciences, or a similar field

Outils

S3

Athena

BigQuery

dbt

Description du poste

Your mission

Our significantly growing Data, AI & MarTech Department is looking for an experienced Data Engineer. The position is responsible for improving and continuously further developing our cloud-based data platform – the heart of Smartbroker‘s technical data infrastructure for business analytics & insights. Join us and play a major role in promoting and enabling a truly data-driven culture across the organisation!

• Develop and improve ourcloud baseddata platform for data analytic and business insights using most innovative data technologies


• Build end-to-end data pipelines from raw data ingestion to consumable data: prepare and clean structured and unstructured data and develop high-quality data models for advanced analytics and AI use cases


• Implement data quality monitoring to ensure accuracy and reliability of data pipelines


• Architect, code, and deploy data infrastructure components


• Collaborate closely withhighly ambitiousdata engineers and analysts in our growing Data, AI &MarTechDepartment as well as product technology colleagues


• Stay up to date with latest market developments in data cloud architecture and share your knowledge

Your mission

Our significantly growing Data, AI & MarTech Department is looking for an experienced Data Engineer. The position is responsible for improving and continuously further developing our cloud-based data platform – the heart of Smartbroker‘s technical data infrastructure for business analytics & insights. Join us and play a major role in promoting and enabling a truly data-driven culture across the organisation!

Job description

• Develop and improve ourcloud baseddata platform for data analytic and business insights using most innovative data technologies


• Build end-to-end data pipelines from raw data ingestion to consumable data: prepare and clean structured and unstructured data and develop high-quality data models for advanced analytics and AI use cases


• Implement data quality monitoring to ensure accuracy and reliability of data pipelines


• Architect, code, and deploy data infrastructure components


• Collaborate closely withhighly ambitiousdata engineers and analysts in our growing Data, AI &MarTechDepartment as well as product technology colleagues


• Stay up to date with latest market developments in data cloud architecture and share your knowledge

Your profile

• University degree in computer science, mathematics, natural sciences, or a similar field


• Several years of experience in data engineering and strong know-how in building robust, scalable, and maintainable data pipelines and analytical data models


• Significant hands-on experience designing and operating data pipelines on cloud-based data platforms (AWS, GCP) using data-native services (S3, Athena, BigQuery…)


• Strong experience in data warehousing and analytics engineering, ideally including dbt and dimensional data modelling


• Excellent SQL skills and a deep understanding of data transformation, performance optimisation, and complex analytical queries


• Deep understanding of software engineering best practices: requirements specification, version control, CI/CD, testing, deployment, and monitoring of data pipelines and transformations


• Strong programming skills in Python, ideally including orchestration frameworks such as Airflow


• Experience with data quality, observability, and testing approaches to deliver reliable and trusted data products


• Knowledge of data streaming technologies like Kafka, Kinesis, Flink and cloud infrastructure is a plus


• Excellent English communication skills, German is a plus


• Interest in finance and fintech industry and a sense of humor

About Us

Among other things, the Smartbroker Group operates Smartbroker+ - a multi-award-winning online broker that is the only provider in Germany to combine the extensive product range of traditional brokers with the extremely favourable conditions of neobrokers. The portfolio also includes the digital fund broker SMARTBROKER Finance (formerly: FondsDISCOUNT.de), while the Group also operates four high-reach stock market portals (wallstreet-online.de, boersenNews.de, FinanzNachrichten.de and ARIVA.de). With several hundred million monthly page impressions, the Group is the largest independent financial portal operator in the German-speaking world and also maintains the largest financial community.

The company is one of the pioneers of digital investment. For more than 25 years, we have been committed to breaking down the barriers to investing and enabling user-friendly and cost-effective investment processing.

Our employees are the key to this success. Due to our strong growth momentum, we have created numerous attractive jobs in recent years. Every day, we strive to build the best team and give our employees the space to develop themselves in the best possible way. A diverse team of top performers ensures that we all learn something new every day. From a small team of around 20 people, we have now grown into a company with around 260 employees (as of 31 December 2023), based in a modern office in Berlin-Kreuzberg.

We see ourselves as an innovative fintech that is embedded in a successful group of companies and thus combines a personal working atmosphere with the advantages of a financially strong public limited company. We rely on flat hierarchies, individual development and agile processes in all parts of the company. We are proud of the personal cohesion within the team and the above-average length of service of many employees. We are committed to diversity and equal opportunities. We strive to build a team that represents a variety of backgrounds, perspectives and skills. The more inclusive we are, the better our work and our team will be.

We encourage women, non-binary and transgender people as well as all members of the LGBTQI+ community, people from marginalised ethnic backgrounds and people with visible or non-visible disabilities to apply if they are looking for an inclusive, diverse and safe working environment.