Data Engineer

Unite Students; Bristol; On-site; GBP 40,000 - 70,000; Full time

Job summary

Join a leading UK company as a Data Engineer and play a crucial role in modernizing their data platform. This position involves designing and developing robust data architectures, optimizing existing systems, and collaborating with teams to fulfill business needs while working with modern tools and technologies. A strong background in SQL, Python, and cloud services, along with excellent problem-solving skills, is essential for success.

Benefits

Annual discretionary bonus

25 days paid holiday

Generous pension scheme

Health and wellbeing benefits

Enhanced Family Leave

Annual ShareSave scheme

Qualifications

• Experience as a Data Engineer with strong skills in SQL, Python, and Spark.
• Familiarity with data pipeline orchestration tools like Airflow.
• Experience with AWS services and understanding of data modelling techniques.

Responsibilities

• Build, test, and maintain scalable data architectures and pipelines.
• Troubleshoot data issues and optimize systems for performance.
• Collaborate with cross-functional teams and communicate technical concepts.

Skills

SQL

Python

Spark

Problem Solving

Data Modelling

Data Pipeline Design

Agile (Scrum)

Tools

Airflow

AWS

Git

Terraform

Talend

Databricks

Azure DevOps

Job description

Social network you want to login/join with:

We are seeking a skilled, motivated Data Engineer to join our dynamic and innovative team. As a Data Engineer in the Data & Insight Team, you will work as part of a team of data engineers to design, develop, test, and maintain data products and our data analytics platform.

This is a fantastic opportunity to join our team at a pivotal moment. As we upgrade our data platform to modernize our analytics and AI capabilities, you`ll play a crucial role in building the architecture and pipelines to deliver the data assets that will drive our future success. If you`re passionate about creating innovative and scalable data solutions and want to be part of a team that will help reshape how Unite Students leverages data, we want to hear from you.

What You`ll Be Doing

• Build, test, and maintain robust, scalable data architectures and pipelines that align with architectural standards and business objectives
• Collaborate with other data engineers to share knowledge and deliver solutions.
• Contribute to the culture of continuous improvement within the team and seek opportunities to automate processes
• Troubleshoot complex data issues and optimize existing systems for performance and reliability
• Implement data validation and quality checks and monitoring solutions to ensure data integrity and observability to meet data governance standards and requirements.
• Collaborate with cross-functional teams to help define requirements and ensure alignment with business needs
• Communicate complex technical concepts effectively to non-technical stakeholders
• Keep informed of new technologies and deliver proof-of-concept projects to drive innovation
• Contribute to Agile ceremonies and technical processes such as code reviews and Change Advisory Board meetings.

What We`re Looking for in You

• Experience of working as a Data Engineer
• Highly proficient in SQL, Python, and Spark (pyspark) for developing and testing data engineering pipelines and products to ingest and transform structured and semi-structured data.
• Understanding of data modelling techniques and data pipeline design patterns and behaviours
• Experience with pipeline management and orchestration tools such as Airflow
• Experience with low/no-code pipeline development tools such as Talend or SnapLogic.
• Experience developing data pipelines using cloud services (AWS preferred) like Lambda, S3, Redshift, Glue, Athena, Secrets Manager or equivalent services.
• Experience of working with APIs for data extraction and interacting with cloud resources via APIs/CLIs/SDKs (e.g., boto3).
• Experience building out a data warehouse on platforms such as Redshift, Snowflake, or Databricks.
• Comfortable working with Git for source control (in Azure DevOps repos or equivalent)
• Experience working in an Agile (Scrum) environment for product delivery using Azure DevOps or similar tools
• Strong problem-solving abilities with the capability to quickly analyze issues and locate performance bottlenecks in code and pipelines
• Excellent communication skills, including the ability to translate complex technical concepts for non-technical audiences and non-data experts.

Nice to Have

• AWS certification(s)
• Experience developing data pipelines with Databricks
• Experience building and deploying data models with dbt
• Infrastructure as Code experience (Terraform)

What You`ll Get in Return

• A discretionary annual bonus so you can share in the company`s success
• 25 days` paid holiday and an annual holiday buying scheme, with 5 additional days awarded for long service
• A generous pension scheme - employer contributions between 5% and 11% depending on how much you save
• Various benefits to support your health and wellbeing including a Healthcare Cash Plan, an Employee Assistance Programme, a Wellbeing platform, and a Gym benefit that you can share with your family and friends
• Enhanced Family Leave including 18 weeks full pay for birthing parents and 4 weeks for non-birthing parents
• Lots of other great benefits including an annual ShareSave scheme, Employee Life Assurance, a discounts portal, and more!