Databricks & Python Real-Time Data Engineer

PERSOL SINGAPORE PTE. LTD.

Singapore

On-site

SGD 120,000 - 190,000

Full time

5 days ago

Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

PERSOL SINGAPORE PTE. LTD. is seeking a senior Data Engineer to design and maintain data processing solutions using Databricks and Python in Singapore.

You will design real-time streaming pipelines with Spark Structured Streaming, optimize workloads, troubleshoot issues, and collaborate with data teams and stakeholders to deliver scalable, reliable data processing. The role requires 5–10 years of experience and a strong foundation in distributed computing.

Qualifications

5–10 years of experience in data engineering / data development.
Hands-on with Databricks and Spark Structured Streaming.
Strong Python programming skills and understanding of distributed computing.

Responsibilities

Develop and maintain data processing solutions using Databricks and Python.
Design and implement real-time data processing pipelines using Spark Structured Streaming.
Troubleshoot and optimize streaming jobs and data workflows.
Work with large volumes of data to ensure reliable, scalable processing.
Monitor Databricks workloads and resolve issues.
Collaborate with data engineers and stakeholders to deliver effective solutions.
Follow best practices for code quality, performance, and maintainability.
Participate in troubleshooting and performance optimization of data pipelines.

Skills

Python programming

Distributed computing

Data pipelines

Troubleshooting

Tools

Databricks

Apache Spark Structured Streaming

Job description

PERSOL SINGAPORE PTE. LTD. is seeking a senior Data Engineer to design and maintain data processing solutions using Databricks and Python in Singapore.

Get your free, confidential resume review.

or drag and drop your file here.