AI Data Engineer

INNOCELLENCE CONSULTING PTE. LTD.; Singapore; On-site; USD 60,000 - 100,000; Full time

Job summary

An innovative consulting firm is seeking a talented Data Science Engineer to join their dynamic team. In this role, you'll design and maintain robust data pipelines that support the processing of clinical study and digital device sensor data. Collaborating closely with data scientists and software engineers, you will ensure the efficient flow of data to analytical tools, while optimizing storage and retrieval processes in cloud environments. This is a fantastic opportunity to work with cutting-edge technologies in AI and Cloud computing, contributing to impactful data-driven business solutions in the healthcare sector. If you are passionate about data engineering and eager to make a difference, this role is perfect for you.

Qualifications

• Experience in designing and building data pipelines using ETL tools.
• Proficiency in programming languages like Python and Java.

Responsibilities

• Design and maintain scalable data pipelines for clinical study data.
• Collaborate with data scientists to integrate data processing with AI algorithms.

Skills

ETL Tools

Apache Spark

Python

Data Warehousing

SQL

AI Solutions

Cloud Computing

Problem-Solving

Communication

Education

Bachelor's Degree in Computer Science

Master's Degree in Engineering

Tools

Apache Beam

Apache Airflow

Docker

Kubernetes

Hadoop

ElasticSearch

Job description

We are looking for a skilled and experienced Data Science Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines to support the processing and analysis of clinical study and digital device sensor data. As a Data Science Engineer, you will work closely with data scientists and software engineers to ensure the efficient and reliable flow of data from source systems to analytical tools and platforms.

Responsibilities:

• Design, develop, and maintain scalable data pipelines to ingest, transform, and load clinical study data from various sources, including digital device sensors.
• Optimize data storage and retrieval processes in cloud-based platforms to ensure high performance and reliability.
• Collaborate with data scientists to integrate data processing pipelines with AI-powered algorithms and third-party analytical tools or platforms.
• Implement data quality checks and monitoring mechanisms to ensure the integrity and accuracy of the data.
• Troubleshoot and resolve issues related to data pipeline performance, reliability, and scalability.
• Work closely with software developers, system architects and other cross-functional teams to develop data-driven business solutions.
• Stay up-to-date with emerging technologies in AI & Cloud computing and best practices in data engineering to continuously improve data processing pipelines and infrastructure.

Requirements:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
• Proven experience in designing and building data pipelines using ETL tools and frameworks such as Apache Spark, Apache Beam, or Apache Airflow.
• Proficiency in programming languages such as Python, Java, or Scala.
• Strong understanding of database systems, data warehousing concepts, SQL and NoSQL.
• Experience with AI and Cloud Computing: Hands-on experience with cloud platforms like AWS and familiarity with AI solutions in these environments.
• Excellent problem-solving and troubleshooting skills with a strong attention to detail and quality.
• Effective communication and collaboration skills with the ability to work in a team environment.

Preferred Qualifications:

• Experience with containerization and orchestration tools such as Docker and Kubernetes.
• Familiarity with big data technologies such as Hadoop, Hive, or Presto.
• Knowledge of distributed computing frameworks such as Apache Hadoop or Apache Spark.
• Familiarity with ElasticSearch or AWS OpenSearch is plus
• Prior experience working with healthcare or clinical data is a plus.