Senior Data Engineer: AWS & Databricks Lakehouse Architect

Rhino Partners Pte Ltd; Singapore; Vor Ort; SGD 120.000 - 180.000; Vollzeit

Zusammenfassung

Rhino Partners Pte Ltd is seeking an experienced Senior Data Engineer (AWS & Databricks) to design, develop and optimise enterprise-scale data platforms in Singapore. You will own data pipelines and lakehouse implementations, collaborating with cross-functional teams to deliver high-quality data products for BI, analytics and AI/ML initiatives.

This hands-on role offers opportunities to shape technical architecture, establish engineering best practices and mentor junior engineers as part of a

Qualifikationen

• Degree in CS/SE/IS or related discipline.
• 6–10 years in data or software engineering.
• At least 2 years in cloud-based data platforms.
• Strong Python, PySpark and SQL.
• Hands-on Databricks, Spark and Delta Lake in production.
• Strong AWS data engineering experience (S3, Glue, IAM, Lambda, Step Functions, CloudWatch).
• Experience with data lakehouse architectures and data modeling.
• Knowledge of CDC, data quality, schema evolution and error handling.
• CI/CD pipelines and Terraform familiarity.
• Data governance and cloud security fundamentals.
• Ability to mentor engineers and review code.

Aufgaben

• Design and maintain scalable batch and streaming pipelines using Python, PySpark and AWS/Databricks.
• Architect modern lakehouse solutions with Delta Lake and Bronze/Silver/Gold layers.
• Build data ingestion frameworks from databases, APIs, files and streaming sources.
• Develop reusable data models and curated datasets for analytics and AI/ML.
• Implement data quality checks, schema validation and data lineage.
• Manage workflows with Databricks Workflows, Lakeflow and AWS services.
• Establish CI/CD, infrastructure as code and automated tests.
• Monitor performance, reliability and cost across Spark, SQL, AWS and Databricks.

Kenntnisse

Analytical thinking

Problem solving

Communication

Ownership

Ausbildung

Bachelor's degree in CS/SE/IS

Tools

Python

PySpark

SQL

Databricks

Apache Spark

Delta Lake

AWS (S3, Glue, IAM)

Lambda

Step Functions

CloudWatch

Lake Formation

Terraform

Git

CI/CD

Airflow

dbt

Jobbeschreibung

Rhino Partners Pte Ltd is seeking an experienced Senior Data Engineer (AWS & Databricks) to design, develop and optimise enterprise-scale data platforms in Singapore. You will own data pipelines and lakehouse implementations, collaborating with cross-functional teams to deliver high-quality data products for BI, analytics and AI/ML initiatives.

This hands-on role offers opportunities to shape technical architecture, establish engineering best practices and mentor junior engineers as part of a