Data Engineer: Spark, Lakehouse & AWS Expert

RAPSYS TECHNOLOGIES PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

RAPSYS TECHNOLOGIES PTE. LTD. is seeking a data engineering professional with strong Python, PySpark and SQL skills, plus hands-on experience with Databricks, Spark and Delta Lake for production-scale pipelines in a cloud environment.

The candidate will design lakehouse architectures, implement incremental ingestion and ensure data quality, security and observability across data platforms. Required experience covers AWS data services (S3, Glue, Lake Formation, IAM, KMS, Lambda, Step Functions,

Qualifications

• Strong Python, PySpark and SQL capabilities with distributed processing and testing.
• Production-scale experience with Databricks, Spark and Delta Lake.
• Hands-on AWS data engineering with S3, Glue, Lake Formation, IAM, KMS, Lambda and related services.
• Experience designing lakehouse architectures and reusable data patterns.
• Experience implementing incremental ingestion, CDC, idempotency and backfills.

Skills

Python

PySpark

SQL

Databricks

Spark

Delta Lake

AWS

S3

Glue

Lake Formation

IAM

KMS

Lambda

Step Functions

EventBridge

CloudWatch

Redshift

Kinesis

Data Lake Architecture

Incremental Ingestion

CDC

Backfills

Data Quality

Schema Validation

Metadata & Lineage

CI/CD

Terraform

Infrastructure as Code

Observability

Dashboards

Security

Encryption

Secret Management

Data Classification

Audit Logging

Review Designs

Tools

Databricks Unity Catalog

Lakeflow

Delta Live Tables

Auto Loader

Structured Streaming

Delta Sharing

Databricks Asset Bundles

Apache Airflow

dbt

Kafka

AWS DMS

MSK

Kinesis

Job description

RAPSYS TECHNOLOGIES PTE. LTD. is seeking a data engineering professional with strong Python, PySpark and SQL skills, plus hands-on experience with Databricks, Spark and Delta Lake for production-scale pipelines in a cloud environment.

The candidate will design lakehouse architectures, implement incremental ingestion and ensure data quality, security and observability across data platforms. Required experience covers AWS data services (S3, Glue, Lake Formation, IAM, KMS, Lambda, Step Functions,