Senior Data Engineer - Spark/Scala | Build Scalable Pipelines

ASTEK SINGAPORE INNOVATION TECHNOLOGY PTE. LTD.; Singapore; On-site; SGD 80,000 - 120,000; Full time

Job summary

A leading technology company in Singapore seeks a Data Software Engineer to work with cutting-edge Big Data services including Spark, Scala, and Databricks. The role requires 6-10 years of experience in data engineering, familiarity with CI/CD pipelines, and a strong understanding of SQL. Candidates should thrive in an Agile/SCRUM environment and have experience with version control and automation testing tools. Join a passionate team to help optimize data-driven projects and enhance data accuracy and traceability.

Qualifications

• 6-10 years of experience as a Data engineer.
• Intermediate level of Database (SQL) skills.
• Demonstrated ability to thrive in an enterprise Agile/SCRUM environment.

Responsibilities

• Monitor and optimize data pipeline performance.
• Implement data governance practices.
• Develop unit and integration test cases.

Skills

Data engineering

SQL

CI/CD

Agile/SCRUM

Linux/Unix

GitHub

Object-oriented programming (Java)

Testing tools

Tools

Spark

Scala

Databricks

PySpark

Jira

Confluence

Job description

A leading technology company in Singapore seeks a Data Software Engineer to work with cutting-edge Big Data services including Spark, Scala, and Databricks. The role requires 6-10 years of experience in data engineering, familiarity with CI/CD pipelines, and a strong understanding of SQL. Candidates should thrive in an Agile/SCRUM environment and have experience with version control and automation testing tools. Join a passionate team to help optimize data-driven projects and enhance data accuracy and traceability.