Staff Data Engineer

PowerToFly; Greater London; Hybrid; GBP 70,000 - 90,000; Full time

Job summary

A leading technology company in Greater London is seeking a Senior Data Engineer to contribute to their Data Engineering team. In this hybrid role, you will work on building and optimising data models, manage data governance issues, and collaborate with various stakeholders to enhance data quality. Ideal candidates should have extensive experience in Data Modelling, Python, AWS, and SQL. This is an exciting opportunity to work with modern tools like Snowflake and Airflow, driving best practices across data disciplines.

Qualifications

• Experience and a passion for Data Modelling, ETL projects, and Big Data as a developer or engineer.
• Good experience in Python, Java or similar languages.
• Proven experience with AWS and SQL.
• Comfortable with general Data Warehousing concepts.

Responsibilities

• Support the building of robust data models downstream of backend services.
• Focus on optimisation of the Data Warehouse to reduce complexity and costs.
• Help define and manage best practices for the Data Warehouse.

Skills

Data Modelling

Python

Java or similar languages

AWS

SQL

Data Warehousing concepts

Data governance

Data quality improvement

Tools

Snowflake

AWS CloudFormation

Terraform

Kafka

Airflow

Job description

Job Description

You’llbe a senior contributor in our Data Engineering team, working across various projects, building out key elements of our data platform using a range of modern tools including Snowflake,dbt, and Airflow.You’llhelp us minimise our cloud costs, drive best practices acrossallour Data Disciplines and scale and automate our data governance.

EnableVXBS (Visa Cross-Border Solutions)to Make Better Decisions, Faster

At the core of this mission sits our data platform.We’regreat believers in powerful, real-time analytics and empowerment of the wider business. We optimise for simplicity and re-usability – all our data lives in one place and is made available via our data warehouse in Snowflake.

Whatyou’llbe working on:

Working in a multi-disciplinary data engineering team, you will:

• Support the building of robust data models downstream of backend services (mostly in Snowflake) that support internal reporting, financial and regulatory use cases.
• Focus on optimisation of our Data Warehouse, spotting opportunities to reduce complexity and cost.
• Help define and manage best practices for our Data Warehouse. This may include payload design of source data, logical data modelling, implementation, metadata, and testing standards.
• Set standards and ways of working with data acrossVXBS,working collaboratively with others to make it happen.
• Take established best practices and standards defined by theteam andapply them within other areas of the business.
• Investigate and effectively work with colleagues from other disciplines tomonitorand improve data quality within the warehouse.
• Contribute to prioritisation of data governance issues.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

• You have experience and a passion for Data Modelling, ETL projects, and Big Data as a developer orengineer
• You havegood experiencein Python,Javaor similar languages
• You have proven experience with AWS
• SQL and data modelling is second nature to you
• You are comfortable with general Data Warehousing concepts
• You strive for improvement in your work and that of others, proactivelyidentifyingissues and opportunities
• You have experience building robust and reliable data setsrequiringa high levelof control
• You have proven experience with stream technologies like Kafka, Kinesis, Pulsar, etc
• You have experience working withIaCtools such as Terraform, AWS CloudFormation, or Ansible

Nice to haves

• Any experience working within a finance function or knowledge of accounting.
• Experience working in a highly regulated environment (e.g. finance, gaming, food, health care).
• Knowledge of regulatory reporting and treasury operations in retail banking
• Have previously useddbt, Databricks, or similar tooling
• Experience working with orchestration frameworks such as Airflow/Prefect
• Design and implementation knowledge of stream processing frameworks like Flink, Spark Streaming etc.
• Used to AGILE ways of working (Kanban, Scrum)

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.