Senior Data Engineer: Spark, Scala & PySpark Pipelines

Tech Aalto Pte ltd; Singapore; On-site; SGD 120,000 - 160,000; Full time

Job summary

Tech Aalto Pte ltd in Singapore is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and platforms for advanced analytics and ML.

The role requires hands-on expertise in Scala, PySpark, Spark and Hadoop, plus cloud exposure. You will collaborate with data scientists, analysts, and product teams to deliver reliable, high-performance data solutions in an agile environment.

Qualifications

• Minimum hands-on data engineering experience in large-scale data environments.
• Strong proficiency in Scala and PySpark for big data processing.
• Deep knowledge of distributed computing frameworks such as Spark and Hadoop.
• Experience with SQL and NoSQL databases, data modeling, and performance tuning.
• Familiarity with CI/CD pipelines, Git, and Agile development methodologies.

Responsibilities

• Design, develop, and maintain robust, scalable data pipelines and ETL processes.
• Build distributed data processing systems using Apache Spark, Hadoop, and related technologies.
• Develop high-performance data applications using Scala and PySpark.
• Implement and maintain data models, schemas, and data warehousing solutions.
• Optimize SQL and NoSQL queries to ensure high performance, scalability, and reliability.
• Ensure data quality, integrity, and security across data platforms.
• Build and maintain CI/CD pipelines and follow DevOps best practices using Git and automated deployment tools.
• Collaborate in Agile/Scrum teams, participating in sprint planning, reviews, and retrospectives.
• Troubleshoot production issues, perform root cause analysis, and implement long-term fixes.
• Document technical designs, workflows, and best practices.

Skills

Scala

PySpark

Distributed computing

SQL

NoSQL databases

CI/CD pipelines

Git

Cloud platforms

Analytics

Communication

Tools

Apache Spark

Hadoop

Kafka

Flink

Spark Streaming

Docker

Kubernetes

Airflow

Argo

Luigi

Snowflake

Redshift

BigQuery

Azure Synapse

Job description

Tech Aalto Pte ltd in Singapore is seeking a Senior Data Engineer to design, build, and optimize scalable data pipelines and platforms for advanced analytics and ML.

The role requires hands-on expertise in Scala, PySpark, Spark and Hadoop, plus cloud exposure. You will collaborate with data scientists, analysts, and product teams to deliver reliable, high-performance data solutions in an agile environment.