Senior Data Engineer (18 Months Contract)

ILLUMINA INTERNATIONAL GENOMICS PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

ILLUMINA INTERNATIONAL GENOMICS PTE. LTD. is seeking a Senior Data Engineer to design and maintain a unified data framework, build scalable pipelines, and deliver robust data models and tooling.

You will partner with data scientists and analysts to translate requirements into production-grade data solutions, ensure data quality and governance, and explore AI-driven improvements to data workflows. The role focuses on handling large volumes of structured and unstructured data, optimizing

Qualifications

• Proficiency in Python, Scala, or Java for data processing and manipulation.
• Strong understanding of data quality, governance, security, and lineage.
• Excellent troubleshooting and collaboration skills with cross-functional teams.
• Experience applying AI or intelligent techniques to improve data workflows.
• Knowledge of C# web development using .NET would be advantageous.

Responsibilities

• Design and maintain a common unified data framework for multi-source data.
• Create and optimize data pipelines for large volumes of structured and unstructured data.
• Collaborate with data scientists to model data requirements.
• Develop tooling for data ingestion, quality, monitoring, and governance.
• Troubleshoot data pipelines and resolve data-related issues.
• Monitor pipeline performance and optimize storage and processing.
• Evaluate third-party data tools to enhance capabilities.
• Apply AI techniques to improve data quality and workflows.

Skills

Python

Scala

Java

Data quality

Data governance

Security

Data lineage

Communication

Automation

Continuous learning

Education

Bachelor's or Master's degree in computer science, Engineering, or related field

Tools

Microsoft .NET

Job description

Position Summary:

We are seeking a highly skilled and motivated Senior Data Engineer to join our team and play a crucial role in building and maintaining our common unified framework, data pipelines, data models, data products, and data engineering tooling.

Position Responsibilities:

• Design, develop, and maintain a common unified data framework that enables seamless integration of data from various sources and systems.
• Create and optimize data pipelines for ingesting, processing, transforming, and storing large volumes of structured and unstructured data.
• Work closely with data scientists and analysts to understand their data requirements and translate them into robust data models.
• Develop and maintain data engineering tooling to improve data ingestion, data quality, data monitoring, and data governance processes.
• Troubleshoot and resolve data pipeline and data-related issues to ensure uninterrupted data flow.
• Monitor data pipeline performance, identify bottlenecks, and optimize data processing and storage for efficiency.
• Evaluate and integrate third-party data tools and technologies to enhance the data engineering capabilities of the organization.
• Experience applying AI or intelligent techniques to improve data quality, monitoring, or development workflows.

Listed responsibilities are an essential, but not exhaustive list, of the usual duties associated with the position. Changes to individual responsibilities may occur due to business needs.

Position Requirements:

• Proficiency in any object oriented or/and functional programming languages such as Python, Scala, or Java for data processing and data manipulation.
• Solid understanding of data quality, data governance, security, and lineage concepts.
• Strong ability to troubleshoot data-related issues effectively.
• Excellent communication and collaboration skills to work effectively with cross-functional teams.
• Demonstrated passion for data engineering, automation, and continuous learning

All listed requirements are deemed as essential functions to this position; however, business conditions may require reasonable accommodations for additional task and responsibilities.

Preferred Experience/Education/Skills:

• Bachelor's or master's degree in computer science, Engineering, or a related field.
• At least 6 years of experience working as a Data Engineer with a proven track record in designing and building production grade data pipelines and data models.
• Experience applying AI or intelligent techniques to improve data quality, monitoring, or development workflows.
• Knowledge of C# web development using Microsoft .NET would be advantageous.