data engineer for public transportation

GVB; Amsterdam; Hybrid; EUR 85,000 - 120,000; Full time

Benefits offered by this job

13th-month pay

Holiday allowance 8%

Sustainable employability allowance 1.

ABP pension

Unlimited travel on GVB

Family travel discounts

Vacation days ~21

Health insurance allowance

Hybrid work

Career development

Job summary

GVB ищет Data Engineer для проектирования и развития конвейеров данных, формирования наборов и моделей данных для отчетов. Вы будете сотрудничать с инженерной, аналитической и архитектурной командами, участвуя в архитектурных решениях и миграциях платформ.

Требуется 7+ лет опыта, знание SQL и Python, Databricks, облачные платформы Azure/AWS и владение нидерландским языком. Команда работает в гибридном формате, с возможностью профессионального роста и развития.

Qualifications

• 7+ лет опыта в работе с данными и инфраструктурой данных.
• Глубокие знания моделирования данных (Kimball, Inmon или единая большая таблица).
• Знание SQL и Python; опыт разработки конвейеров данных.
• Опыт работы с реляционными и нереляционными базами данных.
• Опыт оркестрации ETL-конвейеров.
• Опыт с GIT и CI/CD (Azure DevOps).
• Опыт с Databricks и облачными платформами Azure / AWS.
• Опыт работы в гибкой/agile среде.
• Свободное владение нидерландским языком для коммуникации в команде.

Responsibilities

• Дизайн, построение и улучшение конвейеров данных и интеграций.
• Разработка качественных наборов данных и моделей данных для отчетности.
• Предложение и обоснование технических решений для сложных задач.
• Консультации лидера команды по техническим решениям и стандартам.
• Наставничество младших инженеров и передача знаний.
• Поддержка аналитиков данными и доступ к платформе данных.
• Участие в архитектурных решениях, стандартах и новых технологиях.
• Содействие миграции платформы данных на новую версию.
• Инициатива по улучшению процессов и стандартов разработки.
• Обеспечение надежности и управляемости наборов данных.

Skills

SQL

Python

Data pipelines

Data modeling

ETL orchestration

Git / CI-CD

Databricks

Cloud platforms

Agile

Dutch language

Education

Higher professional or university education in Informatics/CS

Tools

Databricks

Azure DevOps

Git

Azure

AWS

Data warehouse concepts

dbt

Job description

Описание:

GVB provides public transportation services and develops dashboards and data solutions for its operations. The organization works with data engineers, business analysts, data analysts, platform teams, and other IT colleagues to improve its data platform and collaboration.

Задачи:

• Design, build, and improve data pipelines and data integrations
• Develop high-quality datasets and data models for reports and dashboards
• Propose and explain technical solutions for complex data challenges
• Advise the team lead on technical choices, standards, and improvements
• Coach less experienced data engineers and share technical knowledge
• Support data analysts with dataset access and effective use of the data platform
• Contribute to architecture decisions, standards, and new data-engineering technologies
• Support the migration of the data platform to a new version
• Introduce new ways of working and improve technical development standards
• Investigate complex data structures, dependencies, and processing flows
• Design technically sound and maintainable solutions for performance, data, and source-integration issues
• Coordinate data-engineering processes with data analysts, business analysts, architects, platform teams, suppliers, and management
• Take ownership of solution quality and improve processes, pipelines, standards, and platform components
• Ensure datasets are reliable, reusable, and manageable
• Ensure architecture frameworks, security requirements, compliance requirements, data availability, and data integrity are maintained

Требования:

• Higher professional or university education level, for example in Informatics, Computer Science, or a comparable field
• 7 Or more years of relevant work experience
• Extensive experience with data modeling, including Kimball, Inmon, or one-big-table
• Knowledge of SQL and Python and experience developing data pipelines
• Knowledge of relational and non-relational databases
• Experience orchestrating ETL pipelines
• Experience with GIT and CI/CD, for example Azure DevOps pipelines
• Experience with Databricks
• Experience with cloud platforms such as Azure or AWS
• Experience with data warehouse, data lake, and data integration concepts
• Experience working in an agile environment
• Fluent Dutch is required for effective communication within the team and with colleagues
• Strong problem analysis and technical insight
• Ability to work independently, take responsibility, collaborate across disciplines, and support colleagues with technical expertise
• Nice to have: experience with dbt, experience within a data mesh framework, interest in data, public transportation, and modern data platforms

Условия:

• 13Th-month payment, 8% holiday allowance, 1.5% sustainable employability allowance, and pension through ABP
• Free unlimited travel on GVB public transport and discounted travel for the entire family
• Approximately 21 vacation days per year, depending on age, with the option to purchase additional days
• Monthly healthcare insurance allowance of €84.91
• Hybrid work and a home-working allowance
• Training and career development opportunities
• Relocation support is not specified