Associate Data Engineer

Visa; London; Hybrid; GBP 40,000 - 60,000; Full time

Job summary

A leading global payment technology company is seeking a Data Engineer to join their collaborative team. This hybrid role involves executing data engineering projects, building ETL pipelines, and optimizing SQL queries. Ideal candidates will have a degree in an analytical field and entry-level experience with big data technologies like Hadoop and Spark. This is a fantastic opportunity to contribute to innovative solutions in a purpose-driven environment.

Qualifications

• Entry level experience in Hadoop ecosystem and related technologies.
• Working knowledge of writing SQL queries and handling large datasets.
• Experience with Visualization Tools and modern DevOps practices.

Responsibilities

• Develop understanding of Visa's data assets to support Data Science activities.
• Build and maintain ETL pipelines using Spark, Python or Hive.
• Collaborate with Data Engineering teams globally to manage key data assets.

Skills

Problem-solving skills

Data management

SQL

Python

ETL pipelines

Big Data

Education

Bachelor's Degree in an analytical field

Tools

Hadoop

Spark

Hive

Tableau

Power BI

D3

Git

Airflow

MLlib

Unix/Shell

Job description

Company Description

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose - to uplift everyone, everywhere by being the best way to pay and be paid.

Make an impact with a purpose-driven industry leader. Join us today and experience Life at Visa.

Job Description

• Develop a deep understanding of Visa's data assets and how they can be used to support Data Science activities across the company
• Execute data engineering projects ranging from small to large either individually or as part of a project team.
• Build and maintain ETL pipelines in Spark, Python or HIVE that process transaction and account level data and standardize data fields across various data sources
• Troubleshoot
• Design, develop, and maintain reusable data assets
• Define and build technical/data documentation and experience with code version control systems (e.g. git). Ensure data accuracy, integrity and consistency
• Collaborate with Data Engineering teams in North America and other Global regions to production and maintenance of key data assets.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

Required qualifications:

• Bachelor's Degree in an analytical field such as computer science, statistics, finance, economics or relevant area.
• Entry level experience of Hadoop ecosystem and associated technologies, (For e.g. Apache Spark, MLlib, GraphX, iPython, sci-kit,Pandas etc.)
• Working knowledge in writing and optimizing efficient SQL queries with Python, Hive, Scala handling Large Data Sets in Big-Data Environments.
• Experience managing large-scale datasets using Big Data and distributed processing platforms such as Hadoop, Hive and Spark
• Experience with Visualization Tools like Tableau, Power BI, D3
• Experience with modern DevOps practices (including Git and CI/CD)
• Experience with Unix/Shell and exposure to Scheduling tools such as Airflow.
• Strong problem-solving skills

Preferred qualifications:

• Functional knowledge of cloud computing platforms such as AWS, Azure or GCP
• Background in payments or banking

Additional Information

Visa is an EEO Employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, national origin, sexual orientation, gender identity, disability or protected veteran status. Visa will also consider for employment qualified applicants with criminal histories in a manner consistent with EEOC guidelines and applicable local law.