Data Pipeline Analyst

RLG Systems India Private Limited; Stratford-upon-Avon; On-site; GBP 30,000 - 40,000; Full time

Benefits offered by this job

Hybrid worker status

VIP bonus up to 10%

25 days annual leave

Pension up to 8%

Private medical insurance

Life Assurance and Disability cover

Job summary

Reverse Logistics Group (RLG) is seeking a Data Pipeline Analyst in Stratford-upon-Avon to build and maintain scalable data pipelines. You will ensure data accessibility for performance evaluation and decision-making, and work with data stewards, analysts, and stakeholders to drive data-driven initiatives.

The role focuses on creating and maintaining Qlik Talend pipelines to facilitate data migration into databases and the new Data Streams system, using Java for advanced data manipulation and

Qualifications

• Experience using ETL software.
• Experience with Microsoft Excel and related tools.
• Knowledge of SQL.
• Knowledge of Java, Qlik Talend and GitHub desirable.
• Excellent written and verbal communication skills.
• Great attention to detail.
• Strong analytical and problem-solving abilities.

Responsibilities

• Generate and improve Qlik Talend pipelines.
• Create and maintain pipelines for each customer's data.
• Create a reusable toolkit of code for validation and transformations.
• Generate automated validation checks on the received data before loading into the database.
• Become an expert in using the Qlik Talend Studio software for business data transformations.
• Use Java to perform advanced data manipulation.
• Liaise with Data Stewards to ensure pipelines can process customer data.
• Liaise with the business to understand requirements and keep stakeholders informed.

Skills

ETL software experience

Microsoft Excel

SQL knowledge

Java

Qlik Talend

GitHub

Communication skills

Attention to detail

Analytical skills

Education

Degree or equivalent experience

Tools

Qlik Talend Studio

GitHub

Job description

Data Pipeline Analyst

Department: Technology

Employment Type: Permanent - Full Time

Location: Stratford-Upon-Avon

Reporting To: Adam Christopherson

Compensation: £29,500 - £40,000 / year

Description

As a Data Pipeline Analyst, you will be responsible for building and maintaining scalable data pipelines and ensuring data is easily accessible for performance evaluation and decision-making processes. You will work closely with data stewards, analysts, and other stakeholders to drive data-driven initiatives and optimise our data infrastructure. The purpose of this role is to create and maintain Qlik Talend pipelines to allow the smooth transition of this data into the database by manipulating the data and performing checks on it to ensure that the data is accurate.

The Valpak Data Insights (VDI) department and Reverse Logistics Group (RLG) regularly receive data files from their customers systems with regards to Product and transactional data. This data is transformed and loaded into the existing databases using an inhouse built application. VDI will be migrating to the Qlik Talend ETL software on the customer files to load data into both existing databases and the new Data Streams system.

Key Responsibilities

Generate and consistently improve Qlik Talend pipelines

• Create and maintain pipelines for each customer's data
• Create a reusable toolkit of code for validation and transformations that can be used by other customers
• Generate automated validation checks on the received data so that it can be handled more efficiently before loading into the database
• Become an expert in using the Qlik Talend Studio software so that any data transformations requested by the business can be performed
• Use Java to perform advanced manipulation of the data

Ensure standards are maintained

• Make sure that data is handled correctly by Qlik Talend and that poor data is not loaded into the Database
• Use GitHub to allow source control of the created pipelines

Liaise with Data Stewards to make sure that pipelines can process the data received from Customers

• Liaise with business to understand customer requirements, and to keep the business informed of pipeline progress
• Provide feedback to users about the quality of the customers data

Skills, Knowledge & Expertise

Experience, skills

• Experience of using ETL software
• Experience using Microsoft packages, including Excel
• Knowledge of SQL
• Knowledge of Java, Qlik Talend and GitHub (desirable)
• Excellent written and verbal communication skills
• Great attention to detail
• Strong analytical and problem-solving abilities

Qualifications

• Applicants should be educated to degree level or possess solid work experience in related field.

Job Benefits

• Dual Location / Hybrid worker Status
• Participation in our annual Incentive Plan (VIP) - up to 10% bonus
• 25 days annual leave plus bank holidays, volunteering day and your birthday off!
• Option to buy and sell up to 9 days annual leave
• Access to voluntary benefits including private medical insurance, cycle to work scheme, and subsidised gym membership
• Automatic inclusion in Life Assurance, Critical Illness and Disability Income protection schemes
• Pension scheme up to 8% employer contribution
• Access to reward & discount platform
• Wellbeing initiatives