Data Engineer

Assurity Trusted Solutions Pte Ltd; Singapore; On-site; SGD 90,000 - 140,000; Full time

Benefits offered by this job

Learning culture

Family care leave

Birthday leave

Job summary

Assurity Trusted Solutions Pte Ltd is seeking a Data Engineer to design scalable data pipelines, build APIs for data access, and collaborate with cross-functional teams to translate requirements into technical solutions.

The role emphasizes strong Python/PySpark/SQL skills, data modelling, and governance across data lakes and warehouses in a cloud environment. You will mentor teammates while contributing to data-driven products in an Agile setting.

Qualifications

• 3+ years of experience as a Data Engineer with proven data-solutions design and deployment
• Strong Python, PySpark and SQL skills (MySQL, NoSQL)
• Experience with structured, semi-structured and unstructured data
• Experience with AWS ETL and orchestration tools such as Airflow, AWS MSK, Firehose, SNS
• Knowledge of data modelling, data access and data storage infrastructure like Data Lake and Data Warehouses
• Familiarity with Iceberg, Parquet and related formats
• Familiarity with Hadoop, Spark and cloud services (AWS, GCP)
• Excellent communication and ability to work with stakeholders at various levels
• Ability to mentor team members in best practices and new technologies

Responsibilities

• Design, implement, and maintain scalable data pipelines and ETL processes
• Create and manage APIs for data access, integration, and delivery
• Collaborate with cross-functional teams to translate requirements into technical solutions
• Document data transformation processes to enhance efficiency
• Lead data modelling to ensure data architecture supports analytics
• Configure and maintain central data catalog or governance platforms
• Implement data governance and ensure regulatory compliance
• Collaborate with Project Manager, Frontend Developers, UX Designers and Data Analysts
• Support data consumers in subscribing to and using approved data products
• Develop backend APIs and work with databases to support applications
• Work in an Agile CI/CD environment

Skills

Python

PySpark

SQL

AWS

Data modeling

Data governance

Tools

Airflow

Kafka

Data Lake

Parquet

Job description

Assurity Trusted Solutions (ATS) is a wholly owned subsidiary of the Government Technology Agency (GovTech). As a Trusted Partner over the last decade, ATS offers a comprehensive suite of products and services ranging from infrastructure and operational services, authentication services, governance and assurance services as well as managed processes. In a dynamic digital and cyber landscape, where trust & collaboration are key, ATS continues to drive mutually beneficial business outcomes through collaboration with GovTech, government agencies and commercial partners to mitigate cyber risks and bolster security postures.

Key Responsibilities

• Design, implement, and maintain scalable data pipelines and ETL processes to ingest, catalog, normalise data and to ensure high data quality and availability
• Create and manage APIs for data access, integration, and delivery to various stakeholders
• Collaborate with cross-functional teams to gather requirements and translate them into technical solutions
• Optimally structure and document data transformation processes to enhance efficiency and maintainability
• Lead data modelling efforts to ensure that data architecture supports business goals and analytical initiatives
• Configure, curate and maintain the central data catalog or metadata repository e.g. DataZone or similar data catalogue and governance platforms
• Implement best practices for data governance and maintain compliance with relevant regulations
• Collaborate with Project Manager, Frontend Developers, UX Designers and Data Analyst to build scalable data-driven products
• Support data consumers in subscribing to and using approved data products across domains
• Be responsible for developing backend APIs & working on databases to support the applications
• Work in an Agile Environment that practises Continuous Integration and Delivery

Requirements

• At least 3 years of experience as a Data Engineer, with a proven track record of designing and deploying large-scale data solutions
• Strong proficiency in programming languages, particularly Python, PySpark and SQL derivatives (MySQL, NoSQl, etc.)
• Experience working with structured, semi-structured, and unstructured data
• Experience with AWS ETL and orchestration tools such as AWS MSK (Kafka), Firehose, SNS, Airflow or equivalent
• Extensive knowledge of data modelling, data access and data storage infrastructure like Data Lake (both SQL and NoSQL) and Data Warehouses (e.g., AWS S3 , AWS Redshift, AWS Athena, BigQuery, RDBMs, NoSQL DBs)
• Knowledge of open table formats such as Apache Iceberg, Parquet etc.
• Familiarity with data mesh principles, domain ownership, data product thinking and federated governance
• Familiarity with Big Data technologies (e.g., Hadoop, Spark) and cloud services (e.g., AWS, GCP)
• Solid understanding of data architecture concepts, data lakes, and data marts, data catalog, data governance, metadata management and RBAC/ABAC models
• Exceptional analytical and problem-solving skills, with the ability to work in a fast-paced, collaborative environment
• Excellent communication skills and experience working with stakeholders at various levels
• Ability to mentor and guide team members in best practices and new technologies

Join us and discover a meaningful and exciting career with Assurity Trusted Solutions!

The remuneration package will commensurate with your qualifications and experience.

We thank you for your interest and please note that only shortlisted candidates will be notified.

By submitting your application, you agree that your personal data may be collected, used and disclosed by Assurity Trusted Solutions Pte. Ltd. (ATS), GovTech and their service providers and agents in accordance with ATS's privacy statement which can be found at: https://www.assurity.sg/privacy.html or such other successor site.

Benefits

• We promote a learning culture and encourage you to grow and learn
• Annual Leave Benefits with additional perks such as Family Care and Birthday Leave
• Working in a collaborative environment with helpful team members