Data Engineer

VISEO; Singapore; On-site; SGD 80,000 - 120,000; Full time

Job summary

A technology consulting firm in Singapore is looking for a Senior Data Engineer to design, develop, and maintain scalable data infrastructure. The role includes building robust data pipelines and collaborating with teams to ensure data quality and governance. Candidates should have experience in SQL, Python, and big data technologies, alongside a Bachelor's or Master's degree in a relevant field. This position offers an opportunity to drive data-driven decision-making in an innovative environment.

Qualifications

• 6+ years of experience in a relevant role.
• Strong understanding of data security and compliance (e.g., GDPR, HIPAA).
• Familiarity with big data technologies (Hadoop, Spark).

Responsibilities

• Design and maintain scalable data pipelines.
• Develop and optimize data models and data warehouses.
• Collaborate with data scientists and analysts.

Skills

SQL

Python

Data pipeline development

Data architecture

Data modeling

Data governance

Performance optimization

Education

Bachelor's or Master's in computer science, data science, or related field

Tools

Apache Airflow

Kafka

Spark

Microsoft Fabric

Power BI

Azure

AWS

GCP

Azure DevOps

Job description

The Senior Data Engineer plays a critica role in designing, developing, and maintaining scalable data infrastructure and pipelines. This position supports data-driven decision-making across the organization by ensuring data quality, accessibility, and performance.

Roles and Responsibilities

• Data Pipeline Development:Design, build, and maintain robust, scalable data pipelines using tools like Apache Airflow, Kafka, and Spark.
• Data Architecture:Develop and optimizedata models, data warehouses, and ETL processes to support analytics and machine learning initiatives.
• Collaboration:Work closelywith data scientists, analysts, and software engineers to understand data requirements and deliver tailored solutions.
• Data ǪualityG Governance:Ensure data integrity, implement validation checks, and enforce dataGovernance policies.
• Performance Optimization:Monitor and improvedata processing speed,system uptime, and query performance.
• Leadership G Mentorship:Guide junior engineers, promote best practices, and foster a culture of continuous learning.
• Innovation G Research:Stay updated with emerging technologies in AI, automation, and data streaming; lead initiatives to integrate them into existing systems.

Profile

• Bachelor's or Master's in computer science, data science, information technology, or a related field, with6+ years of experience.
• Proficiency inSǪL,Python, andETL/ELT tools
• Experience in Microsoft solutions are as follows:
• Microsoft Fabric
• Power BI
• Experience withbig data technologies(Hadoop, Spark)
• Familiarity withcloud platforms(Azure, AWS, and GCP)
• Strong understanding ofdata modelling,data warehousing, andstream processing
• Knowledge ofdata security,compliance, andgovernance
• Knowledge ofCI/CD pipelinesusing Azure DevOps
• Understanding ofdata security and compliance(e.g., GDPR, HIPAA)

GDPR MESSAGE:

Our privacy policy has been updated to comply with the new regulations. We invite you to consult it by clicking here: https://www.viseo.com/fr/politique-de-confidentialite. The VISEO Group uses the data collected as part of your application to assess your suitability for the job in question. We use the Jazz HR tool to help us in our recruitment process. This tool complies with current regulations on the protection of personal data. The tool is hosted in the United States and is PrivacyShield certified for HR data. In all cases, we may keep your file for 5 years so that we can contact you again if another position matches your profile. You may, of course, object to this. To find out more about how your data is used and how you can exercise your rights, please consult our privacy policy https://www.viseo.com/fr/politique-de-confidentialite.