Data Engineer/Data Testing

Private Advertiser; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

Private Advertiser in Singapore seeks a Data Engineer to design, build, and maintain scalable ETL/ELT pipelines, ingesting data from multiple sources and optimizing storage and performance. You will collaborate with analysts and stakeholders, implement data governance, and develop automated data quality tests using dbt, Great Expectations, and PyTest to ensure integrity.

The role emphasizes SQL, Python, and cloud/data warehousing expertise.

Qualifications

• Bachelor's degree in Computer Science, Information Technology, or related field.
• 3+ years of experience in data engineering, data testing, or QA (adjust based on seniority).
• Strong proficiency in SQL and at least one programming language (Python preferred).
• Experience with ETL/ELT tools (e.g., Informatica, Talend, dbt, Apache Airflow).
• Hands-on experience with cloud data platforms (AWS, Azure, or GCP).
• Familiarity with data warehousing concepts (Snowflake, Redshift, BigQuery, etc.).
• Experience with data testing/automation frameworks (e.g., Great Expectations, PyTest, DBT tests).
• Understanding of data modeling, data governance, and data quality principles
• Strong analytical and problem-solving skills with attention to detail

Responsibilities

• Design and build scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources.
• Develop and optimize data models, warehouses, and data lakes.
• Collaborate with data analysts, scientists, and business stakeholders to understand data requirements.
• Ensure efficient data storage, retrieval, and processing performance.
• Monitor pipeline performance and troubleshoot production issues.
• Implement data governance, security, and compliance best practices.
• Design and execute test plans and test cases for data pipelines, transformations, and reports.
• Perform data validation, reconciliation, and integrity checks across source and target systems.
• Develop automated data quality checks and testing frameworks.
• Identify, document, and track data defects, working with engineering teams on resolution.
• Conduct regression testing for data pipeline changes and migrations.
• Validate business logic and transformation rules against requirements.
• Create and maintain test documentation, including test strategies and QA sign-off criteria.

Skills

SQL proficiency

Python programming

ETL/ELT tools

Cloud platforms

Data warehousing

Data testing frameworks

Data governance

Data modeling

Analytical skills

Education

Bachelor's degree in Computer Science/IT or related field

Tools

Informatica

Talend

dbt

Apache Airflow

Job description

Data Engineering

Design, build, and maintain scalable ETL/ELT pipelines to ingest, transform, and load data from multiple sources

Develop and optimize data models, warehouses, and data lakes

Collaborate with data analysts, scientists, and business stakeholders to understand data requirements

Ensure efficient data storage, retrieval, and processing performance

Monitor pipeline performance and troubleshoot production issues

Implement data governance, security, and compliance best practices

Data Testing & QA

Design and execute test plans and test cases for data pipelines, transformations, and reports

Perform data validation, reconciliation, and integrity checks across source and target systems

Develop automated data quality checks and testing frameworks

Identify, document, and track data defects, working with engineering teams on resolution

Conduct regression testing for data pipeline changes and migrations

Validate business logic and transformation rules against requirements

Create and maintain test documentation, including test strategies and QA sign-off criteria

Required Skills & Qualifications

Bachelor's degree in Computer Science, Information Technology, or related field

3+ years of experience in data engineering, data testing, or QA (adjust based on seniority)

Strong proficiency in SQL and at least one programming language (Python preferred)

Experience with ETL/ELT tools (e.g., Informatica, Talend, dbt, Apache Airflow)

Hands-on experience with cloud data platforms (AWS, Azure, or GCP)

Familiarity with data warehousing concepts (Snowflake, Redshift, BigQuery, etc.)

Experience with data testing/automation frameworks (e.g., Great Expectations, PyTest, DBT tests)

Understanding of data modeling, data governance, and data quality principles

Strong analytical and problem-solving skills with attention to detail

Preferred Qualifications

Experience with CI/CD pipelines for data workflows

Knowledge of version control tools (Git)

Exposure to Agile/Scrum methodologies

Experience with BI tools (Power BI, Tableau) for data validation purposes

Soft Skills

Strong communication skills to liaise between technical and business teams

Ability to work independently and manage multiple priorities

Detail-oriented mindset with a quality-first approach