Associate Data Engineer: Build Cloud Data Pipelines

Spotlight Sports Group; Greater London; Hybrid; GBP 45,000 - 65,000; Full time

Benefits offered by this job

Private medical insurance

Pension scheme

Birthday off

25 days holiday

Job summary

Spotlight Sports Group is seeking an Associate Data Engineer to help build a cloud-based data framework that turns raw data into actionable insights for decision making. You will work under the lead Data Engineer and collaborate with data analysts and stakeholders to ensure data is accessible and efficiently delivered.

You will contribute to the design and deployment of data pipelines, ETLs and a self-serve data platform, while applying best practice data modelling and cloud architecture

Qualifications

• Degree in computer science or a related technical discipline.
• 1.5+ years experience with SQL and data warehousing in a relational DBMS.
• Strong understanding of data modelling concepts and techniques.
• Experience building and scheduling ETL workflows.
• Experience with a cloud database management system like Snowflake.
• Good experience writing high quality, maintainable SQL on large datasets.
• Experience with cloud-based architecture (AWS/Azure).
• Experience using Git and version control tools.
• Experience in working in an Agile methodology.
• Willingness to work with stakeholders to translate requirements into actions.
• Excellent problem solving and attention to detail.
• Strong written and verbal communication.

Responsibilities

• Assist with the delivery of a first in class data infrastructure to support the needs of the Group.
• Contribute to scaling and enhancing the current data infrastructure.
• Build custom automations and manage the Group’s approach to automation via Python or an equivalent.
• Assist with the design, implementation and deployment of data pipelines/structure across the Group.
• Help manage back-end infrastructure for a self-serve platform.
• Assist with the management of ETLs and Data Warehouse performance.
• Provide efficient ways for Data Analysts to access and manipulate data.
• Assist with decision making about data storage and data models.
• Iterate on processes to drive incremental improvements.
• Work to automate processes and improve efficiency of data workflows.
• Troubleshoot and optimise data processes to improve business outcomes.

Skills

SQL

Data warehousing

Data modelling

ETL workflows

Snowflake

AWS/Azure

Git

Agile

Stakeholder communication

Python basics

Education

Degree in computer science or related

Tools

Git

Dbt Cloud

Job description

Spotlight Sports Group is seeking an Associate Data Engineer to help build a cloud-based data framework that turns raw data into actionable insights for decision making. You will work under the lead Data Engineer and collaborate with data analysts and stakeholders to ensure data is accessible and efficiently delivered.

You will contribute to the design and deployment of data pipelines, ETLs and a self-serve data platform, while applying best practice data modelling and cloud architecture