Data Engineer: Databricks & Scalable Data Pipelines

InfoCepts; Singapore; On-site; SGD 70,000 - 110,000; Full time

Job summary

InfoCepts is hiring aspiring / proven Data Engineers to join us in government projects, based in Singapore. The role emphasizes designing scalable data pipelines, ensuring data integrity, and collaborating with stakeholders to meet data needs.

You will work on Databricks-based solutions, data governance, and training end-users to maximize data capabilities. The team fosters secure, compliant data environments and knowledge sharing across projects.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer with Databricks.
• Proficiency in Python/PySpark and data modeling.
• Experience in Data Warehouse/Lakehouse projects.
• Experience with ETL tools and data integration processes.
• Excellent communication skills with the ability to explain complex concepts to non-technical users.
• Experience in providing user support and training is highly desirable.

Responsibilities

• Design and develop scalable data pipelines, ensuring data integrity and availability.
• Collaborate with stakeholders to understand their data needs and provide solutions.
• Assist users in utilizing effectively, providing training and support to enhance their data processing and analysis capabilities.
• Monitor and optimize data workflows and queries for performance improvements.
• Implement best practices for data governance, security, and compliance within client’s environments.
• Document data architecture, pipelines, and processes for knowledge sharing and future reference.
• Troubleshoot and resolve issues related to data processing and Databricks functionalities.

Skills

Databricks

Python/PySpark

Data modeling

ETL pipelines

Data warehouse

Lakehouse

Data governance

Security & compliance

Documentation

Communication

User training

Education

Bachelor's degree in CS/Engineering

Tools

SQL

Job description

InfoCepts is hiring aspiring / proven Data Engineers to join us in government projects, based in Singapore. The role emphasizes designing scalable data pipelines, ensuring data integrity, and collaborating with stakeholders to meet data needs.

You will work on Databricks-based solutions, data governance, and training end-users to maximize data capabilities. The team fosters secure, compliant data environments and knowledge sharing across projects.