Principal Big Data Engineer

Borr Drilling; Singapore; On-site; SGD 70,000 - 120,000; Full time

Job summary

A leading company in the drilling industry is seeking a Big Data Engineer to design, implement, and optimize scalable data pipelines. The role involves ensuring data quality and integrating data from various sources while collaborating with data scientists and analysts. Candidates should have significant experience with big data technologies like Hadoop and Spark, alongside programming proficiency in languages such as Python or Java.

Qualifications

• Proven experience as a Big Data Engineer or similar role.
• Experience with technologies such as Hadoop, Spark, Kafka.
• Proficiency in programming languages like Python, Java, or Scala.

Responsibilities

• Design and implement scalable data pipelines.
• Ensure data quality, integrity, and consistency.
• Optimize data storage and retrieval processes.

Skills

Big Data Technologies

Data Quality

Data Integration

SQL

NoSQL

Job description

Design and implement scalable data pipelines to collect, process, and store large volumes of structured and unstructured data.

Ensure data quality, integrity, and consistency across various data sources.

Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.

Integrate data from multiple sources, including databases, APIs, and third-party data providers.

Build and maintain big data infrastructure using technologies

Optimize data storage and retrieval processes to improve performance and reduce costs.

Proven experience as a Big Data Engineer or similar role.
Experience with big data technologies such as Hadoop, Spark, Kafka, Hive, HBase, etc

Proficiency in programming languages such as Python, Java, or Scala.
Strong knowledge of SQL and NoSQL databases.
Knowledge of machine learning and data analytics.