Data Engineer III - Reliability Engineer

ASTREYA ASIA PACIFIC PTE. LIMITED; High Street, Penarth; On-site; GBP 65,000 - 100,000; Full time

Job summary

We are seeking a Data Engineer to join our analytics team in the United Kingdom. The role focuses on expanding and optimizing data and pipeline architecture, supporting data analysts, and ensuring consistent data delivery across projects.

The ideal candidate will have a strong background in ETL, data warehousing, and programming with SAS, Python, Java, and MATLAB. Collaboration with executive, product, data, and design teams is essential.

Qualifications

• Bachelor’s degree (B.S./B.A.) or Diploma with 5–8 years of related experience.
• Experience in building and optimizing data pipelines.
• Proficiency in SAS, Python, Java and MATLAB.
• Strong SQL and NoSQL database skills.
• Experience with data warehousing technologies (Hadoop, MapReduce, Hive, Presto).
• Proficiency with UNIX/Linux operating systems.

Responsibilities

• Create and maintain scalable data pipeline architecture.
• Assemble large, complex data sets to meet business requirements.
• Identify and implement internal process improvements for data delivery and scalability.
• Build infrastructure for ETL from diverse data sources.
• Develop analytics tools to derive insights on customer acquisition and operations.
• Support cross-functional teams with data infrastructure needs.
• Create data tools to assist analytics production.
• Collaborate with data experts to enhance system functionality.
• Perform other duties as required.

Education

Bachelor’s degree or Diploma

Tools

SAS

Python

Java

MatLab

ETL

SQL

NoSQL

Hadoop

MapReduce

Hive

Presto

UNIX

Linux

Job description

What this Job Entails

We are looking for a Data Engineer to join our growing team of analytics experts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The Data Engineer will support our data analysts on data initiatives and will ensure optimal data delivery architecture is consistent throughout ongoing projects.

Roles and Responsibilities

• Create and maintain optimal data pipeline architecture

• Assemble large, complex data sets that meet functional / non-functional business requirements.

• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.

• Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources

• Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.

• Work with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.

• Create data tools for team members to assist them in building and optimizing analytics production.

• Work with data and analytics experts to strive for greater functionality in our data systems.

• Other duties as required. This list is not meant to be a comprehensive inventory of all responsibilities assigned to this position

Required Qualifications/Skills

• Bachelor’s degree (B.S/B.A) or Diploma and 5 to 8 years’ related experience and/or training; or equivalent combination of education and experience

• Networks with senior internal and external personnel in own area of expertise

• Demonstrates good judgment in selecting methods and techniques for obtaining solutions

• Proficiency in languages SAS, Python, Java, and MatLab

• ETL (Extract, Transform, and Load)

• Database - SQL and NoSQL

• Data Warehousing – Hadoop, MapReduce, HIVE, Presto

• Operating system: UNIX, Linux

• Follows standard practice and procedures when analyzing situations or data

Preferred Qualifications

• Programming language: Javascript, R

• Basic Machine Learning