Databricks Data Engineer: Build Scalable Pipelines & Insights

InfoCepts; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

InfoCepts is a global leader in data & analytics solutions seeking Data Engineers to join government projects in Singapore. The role emphasizes building scalable data pipelines, ensuring data integrity, and collaborating with stakeholders to deliver data-driven solutions.

Proficiency in Python/PySpark and Databricks, plus experience with data warehousing and ETL processes, is required. Strong communication and training skills are highly valued.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Data Engineer with a strong focus on Databricks.
• Proficiency in Python/Pyspark and data modeling techniques.
• Experience in Datawarehouse/Lakehouse projects.
• Experience with ETL tools and data integration processes.
• Excellent communication skills with the ability to explain complex concepts to non-technical users.
• Experience in providing user support and training is highly desirable.

Responsibilities

• Design and develop scalable data pipelines, ensuring data integrity and availability.
• Collaborate with stakeholders to understand their data needs and provide solutions.
• Assist users in utilizing effectively, providing training and support to enhance their data processing and analysis capabilities.
• Monitor and optimize data workflows and queries for performance improvements.
• Implement best practices for data governance, security, and compliance within client's environments.
• Document data architecture, pipelines, and processes for knowledge sharing and future reference.
• Troubleshoot and resolve issues related to data processing and Databricks functionalities.

Skills

Databricks

Python

PySpark

Data Modeling

ETL

Data Warehousing

Education

Bachelor's degree

Tools

SQL

ETL Tools

Job description

InfoCepts is a global leader in data & analytics solutions seeking Data Engineers to join government projects in Singapore. The role emphasizes building scalable data pipelines, ensuring data integrity, and collaborating with stakeholders to deliver data-driven solutions.

Proficiency in Python/PySpark and Databricks, plus experience with data warehousing and ETL processes, is required. Strong communication and training skills are highly valued.