Data Engineer

DUOTECH PTE. LTD.; Greater London; On-site; GBP 40,000 - 60,000; Full time

Job summary

A leading data engineering firm in the UK is looking for a Data Engineer. In this role, you will oversee data ingestion and integration, maintain a data warehouse, and write scripts for analysis. Your responsibilities include creating an automated data visualization system, designing scalable data engineering solutions, and ensuring data security. Proficiency in SQL, Python, R, and experience with cloud services like AWS are essential. Join us to contribute to innovative data solutions in a collaborative environment.

Qualifications

• Strong command of relational databases and SQL.
• Proficiency with Python or R.
• General data manipulation skills.
• Ability to learn new techniques and troubleshoot code independently.
• Experience with cloud infrastructure services, preferably AWS.

Responsibilities

• Maintain and build on the data warehouse and analytics environment.
• Design, implement, and maintain data engineering solutions.
• Build reports and data visualizations from the data warehouse.
• Produce scalable code to automate data management tasks.
• Implement security measures in the data environment.

Skills

Relational databases

SQL

Python

R

Data visualization

Tools

AWS

PowerBI

Tableau

Gitlab

Job description

About Hytech

Hytech is a leading management consulting firm headquartered in Australia and Singapore, specialising in digital transformation for fintech and financial services companies. We provide comprehensive consulting solutions, as well as middle- and back-office support, to empower our clients with streamlined operations and cutting‑edge strategies.

With a global team of over 2,000 professionals, Hytech has established a strong presence worldwide, with offices in Australia, Singapore, Malaysia, Taiwan, Philippines, Thailand, Morocco, Cyprus, Dubai and more.

Overview of role

The Data Engineer will oversee the company’s data ingestion / integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data ingestion / integration and analysis. This role will work closely and collaboratively with members of the Data & Analytics and Development teams to define requirements, mine and analyze data, integrate data from a variety of sources, and deploy high‑quality data pipelines in support of the analytics needs. This person will also be responsible for creating an automated reporting / data visualization system based on the request of internal stakeholders.

Job Responsibilities

• Maintain and build on our data warehouse and analytics environment, the home for various source data generated in the company.
• Design, implement, test, deploy, and maintain stable, secure, and scalable data engineering solutions and pipelines in support of data and analytics projects, including integrating new sources of data into our central data warehouse and moving data out to applications.
• Build reports and data visualizations, using data from the data warehouse and other sources.
• Produce scalable, replicable code and engineering solutions that help automate repetitive data management tasks.
• Perform one‑off data manipulation and analysis on a wide variety of source data.
• Implement and monitor best‑in‑class security measures in our data warehouse and analytics environment.
• Help other data team staff troubleshoot their SQL, Python, or R code.

Requirements

Strong command of relational databases and SQL. Extract, Transform, and Load (ETL) data into a relational database.

• Proficiency with Python or R, especially for data manipulation and analysis, and ability to build, maintain and deploy sequences of automated processes with these tools.
• General data manipulation skills: read in data, process and clean it, transform and recode it, merge different data sets together, reformat data between wide and long, etc.
• Demonstrated ability to learn new techniques and troubleshoot code without support, ex. find answers to common programming challenges on Google. In other words, be able to learn on the job.
• Demonstrated ability to write clear code that is well‑documented and stored in a version control system (we use Gitlab).
• Use APIs to push and pull data from various data systems and platforms.
• Experience working with cloud infrastructure services like Amazon Web Services is preferred.
• Experience with data visualization (PowerBI, Tableau) is helpful, but not required.