(Sr.) Data Engineer (m/f/d)

Smartbroker AG; Berlin; Vor Ort; EUR 90.000 - 130.000; Vollzeit

Zusammenfassung

Smartbroker AG is seeking an experienced Data Platform Engineer to develop and continuously improve our cloud-based data platform, the core of our analytics infrastructure. You will build end-to-end data pipelines, prepare and model data for advanced analytics and AI use cases.

You will collaborate with ambitious data engineers and analysts within our Data, AI & MarTech Department, contribute to data quality and observability, and stay current with data cloud innovations across AWS and GCP.

Qualifikationen

• University degree in computer science, mathematics, natural sciences, or a related field.
• Several years of experience in data engineering and building robust, scalable data pipelines and analytical data models.
• Significant hands-on experience designing and operating data pipelines on cloud-based platforms (AWS, GCP) using data-native services (S3, Athena, BigQuery).
• Strong experience in data warehousing and analytics engineering, ideally including dbt and dimensional data modelling.
• Excellent SQL skills and a deep understanding of data transformation, performance optimization, and complex analytical queries.
• Solid software engineering practices: requirements, version control, CI/CD, testing, deployment, and monitoring of data pipelines.
• Strong Python programming skills, ideally with orchestration frameworks such as Airflow.
• Experience with data quality, observability, and testing to deliver reliable data products.
• Experience supporting AI/ML use cases from a data engineering perspective is a plus.

Aufgaben

• Develop and improve our cloud-based data platform for analytics and insights.
• Build end-to-end data pipelines from raw data ingestion to consumable data and develop data models for advanced analytics and AI use cases.
• Implement data quality monitoring to ensure accuracy and reliability of data pipelines.
• Architect, code, and deploy data infrastructure components.
• Collaborate with data engineers, analysts, and product tech colleagues to advance data capabilities.
• Stay up to date with latest developments in data cloud architecture and share knowledge.

Kenntnisse

Data pipelines

Cloud data platforms

Python

SQL

Airflow

CI/CD

Data quality

English communication

German language

Ausbildung

University degree in Computer Science

Tools

AWS

GCP

S3

BigQuery

dbt

Airflow

Kafka

Kinesis

Flink

Jobbeschreibung

Your mission

Our significantly growing Data, AI & MarTech Department is looking for an experienced Data Platform Engineer. The position is responsible for improving and continuously further developing our cloud-based data platform – the heart of Smartbroker‘s technical data infrastructure for business analytics & insights. Join us and play a major role in promoting and enabling a truly data-driven culture across the organisation!

Job description

• Develop and improve ourcloud baseddata platform for data analytic and business insights using most innovative data technologies
• Build end-to-end data pipelines from raw data ingestion to consumable data: prepare and clean structured and unstructured data and develop high-quality data models for advanced analytics and AI use cases
• Implement data quality monitoring to ensure accuracy and reliability of data pipelines
• Architect, code, and deploy data infrastructure components
• Collaborate closely withhighly ambitiousdata engineers and analysts in our growing Data, AI &MarTechDepartment as well as product technology colleagues
• Stay up to date with latest market developments in data cloud architecture and share your knowledge

Your profile

• University degree in computer science, mathematics, natural sciences, or a similar field
• Several years of experience in data engineering and strong know-how in building robust, scalable, and maintainable data pipelines and analytical data models
• Significant hands-on experience designing and operating data pipelines on cloud-based data platforms (AWS, GCP) using data-native services (S3, Athena, BigQuery…)
• Strong experience in data warehousing and analytics engineering, ideally including dbt and dimensional data modelling
• Excellent SQL skills and a deep understanding of data transformation, performance optimisation, and complex analytical queries
• Deep understanding of software engineering best practices: requirements specification, version control, CI/CD, testing, deployment, and monitoring of data pipelines and transformations
• Strong programming skills in Python, ideally including orchestration frameworks such as Airflow
• Experience with data quality, observability, and testing approaches to deliver reliable and trusted data products
• Experience supporting AI/ML use cases from a data engineering perspective, such as preparing high-quality datasets, building data pipelines for AI applications, or working with embeddings and vector databases, is a plus
• Knowledge of data streaming technologies like Kafka, Kinesis, Flink and cloud infrastructure is a plus
• Excellent English communication skills, German is a plus
• Interest in finance and fintech industry and a sense of humor

About Us

Among other things, the Smartbroker Group operates Smartbroker+ - a multi-award-winning online broker that is the only provider in Germany to combine the extensive product range of traditional brokers with the extremely favourable conditions of neobrokers. The portfolio also includes the digital fund broker SMARTBROKER Finance (formerly: FondsDISCOUNT.de), while the Group also operates four high-reach stock market portals (wallstreet-online.de, boersenNews.de, FinanzNachrichten.de and ARIVA.de). With several hundred million monthly page impressions, the Group is the largest independent financial portal operator in the German-speaking world and also maintains the largest financial community. The company is one of the pioneers of digital investment. For more than 25 years, we have been committed to breaking down the barriers to investing and enabling user-friendly and cost-effective investment processing. Our employees are the key to this success. Due to our strong growth momentum, we have created numerous attractive jobs in recent years. Every day, we strive to build the best team and give our employees the space to develop themselves in the best possible way. A diverse team of top performers ensures that we all learn something new every day. From a small team of around 20 people, we have now grown into a company with around 260 employees (as of 31 December 2023), based in a modern office in Berlin-Kreuzberg. We see ourselves as an innovative fintech that is embedded in a successful group of companies and thus combines a personal working atmosphere with the advantages of a financially strong public limited company. We rely on flat hierarchies, individual development and agile processes in all parts of the company. We are proud of the personal cohesion within the team and the above-average length of service of many employees. We are committed to diversity and equal opportunities. We strive to build a team that represents a variety of backgrounds, perspectives and skills. The more inclusive we are, the better our work and our team will be.