Data Engineer - Databricks & Informatica

CITTABASE SOLUTIONS PTE. LTD.; Singapore; On-site; SGD 100,000 - 120,000; Full time

Job summary

A technology solutions company in Singapore is seeking an experienced Data Engineer with 6-8 years of experience. The role involves developing data pipelines and applications, leading configuration and testing, and mentoring junior engineers. Candidates should have experience with Databricks, Hadoop, and INFORMATICA, alongside certifications in data engineering. Strong skills in Spark, Python, PySpark, and SQL are essential. This opportunity offers a dynamic work environment focused on innovative data solutions.

Qualifications

• 6-8 years of experience in data engineering.
• Over 2 years developing data lakes and data marts.
• 1-3 years of experience with INFORMATICA IDMC/PowerCenter.

Responsibilities

• Create technical documentation for data solutions.
• Lead configuration, build, and testing of data applications.
• Mentor and develop junior engineers.

Skills

Spark

Python

PySpark

SQL

Education

Certified Data Engineer from Databricks

INFORMATICA Professional-level certificate

Tools

Databricks

Hadoop

INFORMATICA IDMC

PowerCenter

Job description

Job Description

Create technical, functional, and operational documentation for data pipelines and applications. Understand business requirements to drive the design of data solutions/applications and technical architecture. Work with other developers, designers, and architects (local and remote) to ensure data applications meet requirements and performance, data security, and analytics goals. Lead the configuration, build, and testing of data applications and technical architecture. Establish and grow a data engineering framework to ensure the reliability, scalability, quality and efficiency of data pipelines, storage, processing and integration. Coordinate and participate in structured peer reviews / walkthroughs / code reviews. Maintain and/or update technical and/or industry knowledge and skills through continuous learning activities. Mentor and develop junior engineers.

Requirements & Qualifications

• Experience: 6 – 8 Years
• Has more than 2 Years of experience in developing data lakes, and datamarts on the Databricks/Hadoop platform.
• 1-3 years of experience in INFORMATICA IDMC/PowerCenterServices
• Skilled in Spark, Python, PySpark, and SQL.
• Must be a Certified Data Engineer from Databricks AND/OR Should possess an INFORMATICA Professional-level certificate on IDMC IntegrationServices (CDI or CAI)
• Good understanding of developing data warehouses, data marts, etc.

Good presentation skills with the ability to convey complex ideas to peers and management.