Data Engineer: ETL, Data Quality & QA Automation

Private Advertiser; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Private Advertiser in Singapore seeks a Data Engineer to design, build, and maintain scalable ETL/ELT pipelines, ingesting data from multiple sources and optimizing storage and performance. You will collaborate with analysts and stakeholders, implement data governance, and develop automated data quality tests using dbt, Great Expectations, and PyTest to ensure integrity.

The role emphasizes SQL, Python, and cloud/data warehousing expertise.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 3+ years of experience in data engineering, data testing, or QA (adjust based on seniority).
• Strong proficiency in SQL and at least one programming language (Python preferred).
• Experience with ETL/ELT tools (e.g., Informatica, Talend, dbt, Apache Airflow).
• Hands-on experience with cloud data platforms (AWS, Azure, or GCP).
• Familiarity with data warehousing concepts (Snowflake, Redshift, BigQuery, etc.).
• Experience with data testing/automation frameworks (e.g., Great Expectations, PyTest, DBT tests).
• Understanding of data modeling, data governance, and data quality principles
• Strong analytical and problem-solving skills with attention to detail

Responsibilities

• Design and build scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources.
• Develop and optimize data models, warehouses, and data lakes.
• Collaborate with data analysts, scientists, and business stakeholders to understand data requirements.
• Ensure efficient data storage, retrieval, and processing performance.
• Monitor pipeline performance and troubleshoot production issues.
• Implement data governance, security, and compliance best practices.
• Design and execute test plans and test cases for data pipelines, transformations, and reports.
• Perform data validation, reconciliation, and integrity checks across source and target systems.
• Develop automated data quality checks and testing frameworks.
• Identify, document, and track data defects, working with engineering teams on resolution.
• Conduct regression testing for data pipeline changes and migrations.
• Validate business logic and transformation rules against requirements.
• Create and maintain test documentation, including test strategies and QA sign-off criteria.

Skills

SQL proficiency

Python programming

ETL/ELT tools

Cloud platforms

Data warehousing

Data testing frameworks

Data governance

Data modeling

Analytical skills

Education

Bachelor's degree in Computer Science/IT or related field

Tools

Informatica

Talend

dbt

Apache Airflow

Job description

Private Advertiser in Singapore seeks a Data Engineer to design, build, and maintain scalable ETL/ELT pipelines, ingesting data from multiple sources and optimizing storage and performance. You will collaborate with analysts and stakeholders, implement data governance, and develop automated data quality tests using dbt, Great Expectations, and PyTest to ensure integrity.

The role emphasizes SQL, Python, and cloud/data warehousing expertise.