Software Development Engineer I

OnebyZero .; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

OneByZero, a Frontier Systems Integrator in Singapore, seeks a Data Pipeline Engineer to design, build, and optimize scalable data ingestion and transformation pipelines on AWS.

You will implement data quality frameworks, govern data lake environments, and collaborate with cross-functional teams across APAC to deliver enterprise-grade data solutions.

The role emphasizes IaC, CI/CD, testing, and governance, with opportunities to work on mission-critical banking, telco, insurer, and retail projects.

Qualifications

• 5+ years of experience in data engineering or data platform development.
• Hands-on experience with AWS Glue, Lake Formation, S3 and Athena.
• Proficiency in Python, PySpark, and SQL.
• Experience building ETL/ELT pipelines in cloud-native environments.
• IaC experience with Terraform or AWS CDK.
• Strong data modeling, governance, and metadata management.
• Experience with automated testing and deployment practices.

Responsibilities

• Develop end-to-end data ingestion pipelines from source systems through AWS S3, Glue ETL, and Lake Formation curated zones.
• Design and implement ETL transformations based on data mappings.
• Build and maintain data quality validation frameworks for completeness and schema conformance.
• Configure error handling, exception management, and dead-letter queue patterns for failed ingestion records.
• Register and manage datasets within AWS Glue Data Catalog with governance tagging.
• Develop and maintain IaC using Terraform or AWS CDK for data platform resources.
• Execute unit and integration testing to validate pipeline functionality and data accuracy.
• Support UAT by validating output datasets, schemas, and record counts with stakeholders.
• Document pipelines, runbooks, and data flow diagrams.
• Participate in Agile ceremonies including sprint planning, stand-ups, demos, and code reviews.

Skills

Data engineering

ETL development

Python

PySpark

SQL

Data governance

Education

Bachelor's degree in Computer Science, IT, or Engineering

Tools

AWS Glue

AWS Lake Formation

Amazon S3

Amazon Athena

Terraform

AWS CDK

Great Expectations

Job description

Paya Lebar Road, Singapore

OneByZero is a Frontier Systems Integrator building agentic AI systems for leading banks, telcos, insurers, and retailers across Asia Pacific. We work on mission-critical problems for organizations operating the region's financial and digital infrastructure. Operating exclusively on AWS, we combine deep technical expertise with strong partnership programs that enable innovation, scale, and delivery excellence. We build with people who are technically serious, outcome-focused, and passionate about solving complex enterprise challenges.

The Role

We are seeking a highly skilled Data Pipeline Engineer to design, build, and optimize scalable data ingestion and transformation pipelines on AWS. The ideal candidate will be responsible for developing end-to-end data pipelines, implementing data quality frameworks, and enabling reliable data delivery into a governed data lake environment.

This role requires strong expertise in AWS data services, ETL development, Infrastructure as Code (IaC), and modern data engineering best practices.

Key Responsibilities

• Develop and implement end-to-end data ingestion pipelines from source systems through AWS S3, AWS Glue ETL, and AWS Lake Formation curated zones.
  
• Design and implement ETL transformations based on defined data mapping specifications.
  
• Build and maintain data quality validation frameworks to ensure completeness, schema conformance, and referential integrity.
  
• Configure error handling, exception management, and dead-letter queue patterns for failed ingestion records.
  
• Register and manage datasets within AWS Glue Data Catalog, ensuring standardized metadata tagging and governance compliance.
  
• Develop and maintain Infrastructure as Code (IaC) using Terraform or AWS CDK for data platform resources.
  
• Execute unit testing and integration testing to validate pipeline functionality and data accuracy.
  
• Support User Acceptance Testing (UAT) by validating output datasets, schemas, and record counts with business stakeholders.
  
• Create and maintain technical documentation including pipeline configurations, runbooks, and data flow diagrams.
  
• Participate in Agile ceremonies including sprint planning, stand-ups, demos, and code reviews.
  

Requirements

Required Skills & Experience

• 5+ years of experience in Data Engineering or Data Platform Development.
  
• Strong hands-on experience with AWS Glue, AWS Lake Formation, Amazon S3, and Amazon Athena.
  
• Proficiency in Python, PySpark, and SQL.
  
• Experience building ETL/ELT pipelines in cloud-native environments.
  
• Hands-on experience with Infrastructure as Code (IaC) tools such as Terraform or AWS CDK.
  
• Strong understanding of data modeling, data governance, and metadata management.
  
• Experience with automated testing and deployment practices.
  

Good to Have

• Experience with Great Expectations or similar data quality frameworks.
  
• Exposure to SHIP-HATS CI/CD pipelines.
  
• Knowledge of enterprise data cataloging and governance solutions.
  
• Prior experience working with Government Agencies or Public Sector projects.
  

Education

• Bachelor's degree in Computer Science, Information Technology, Engineering, or a related discipline.
  

What We Offer

Competitive compensation benchmarked to market. The opportunity to work on AI transformation programmes that matter to the institutions millions of people in Asia Pacific depend on. A team that spans 10 markets, brings together some of the most experienced AI, data, and enterprise technology practitioners in the region, and moves fast without losing quality. Access to the AWS partnership programmes and frontier AI tooling that most firms in this region do not have. A firm that is building something genuinely new, with a leadership team that has scaled and delivered before.

OneByZero is an equal opportunity employer. We are committed to building a diverse and inclusive team and welcome applications from candidates of all backgrounds.

Why OneByZero

Agentic AI in regulated enterprise is the hardest version of this problem. The clients are the institutions that run the financial infrastructure of Asia Pacific. The constraints are real. The stakes are high.

OBZ is one of the few firms in the region doing this work at production scale in regulated industries, with an AWS partnership that puts you at the frontier of what is deployable. You will build systems that matter, work in squads small enough that your contribution is visible, and use AI coworkers as a genuine force multiplier.

If you are at the start of your career and want to be shaped by the hardest agentic engineering problems in the region, this is where that happens. If you are experienced and want to work on problems that are still genuinely unsolved, this is also where that happens.

Note - Only candidates with existing unrestricted work authorization in Singapore will be considered, as visa sponsorship is not available for this position