Senior Data Engineer — Databricks, Data Vault & Analytics

BEC Financial Technologies; Warszawa; On-site; PLN 180,000 - 270,000; Full time

Benefits offered by this job

Mental health support

Free lunch at the office

Professional development budget

Referral bonus up to PLN 10,000

PLN 600 on a benefit platform a month

Passion clubs and social events

Job summary

BEC Financial Technologies in Warsaw is seeking a Senior Data Engineer to advance our data platform within the Customer Rating & Analytics team in the Regulatory Reporting Solutions domain. You will help transform legacy data warehousing into a Databricks-based platform and build end-to-end data processing flows to deliver actionable insights for end users.

You will mentor peers, collaborate with cross-functional teams, and contribute to the design of dashboards and reports while supporting

Qualifications

• Several years of proven experience as data engineer in the financial industry across the whole development and operations cycle.
• 5-10 years of knowledge in data moulding
• 3-5 years of hands-on experience with Databricks and PySpark
• 3-5 years experience in working with the Data Vault concept
• 5-10 years of hands-on experience with Informatica PowerCenter creating ETL solutions
• 5-10 years hands-on experience in writing and optimizing SQL (SQLServer preferred)
• Experience with Metadata-driven automation
• Experience with Data contracts and governance
• 5-10 years of hands-on experience in Python

Responsibilities

• Participate and act as a technical mentor in the tech transformation of existing solutions from legacy Data Warehouse based on Netezza/Informatica to a Databricks based platform
• Develop end-to-end data processing flows including acquisition, cleansing, integration/consolidation, transformation and delivery/exposure
• Support the development of User Interfaces (dashboards, reports or other data visualizations) enabling actionable insights in close collaboration with Business Analysts
• Ensure timely delivery of housekeeping and maintenance tasks
• Collaborate with the team architect, data engineers, business analysts and software developers inside and outside of the Reporting Solutions domain

Skills

Data moulding

Data governance

Metadata-driven automation

Data contracts

Tools

Databricks

PySpark

Data Vault

Informatica PowerCenter

SQL

Python

Netezza

Job description

BEC Financial Technologies in Warsaw is seeking a Senior Data Engineer to advance our data platform within the Customer Rating & Analytics team in the Regulatory Reporting Solutions domain. You will help transform legacy data warehousing into a Databricks-based platform and build end-to-end data processing flows to deliver actionable insights for end users.

You will mentor peers, collaborate with cross-functional teams, and contribute to the design of dashboards and reports while supporting