Data Scientist: AI & Big Data Pipelines

JEET ANALYTICS PTE. LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

JEET ANALYTICS PTE. LTD. is seeking a skilled Data Engineer to design, build and optimize scalable ETL/ELT data pipelines for large-scale datasets. You will work with Python, PySpark, Spark SQL, Scala and cloud services to deliver batch and real-time processing solutions.

The role requires strong SQL capabilities and experience with Databricks, Hadoop, Kafka and Airflow, plus AI/NLP competencies. Join a fast-moving team delivering enterprise data platforms in a Singapore-based environment.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or related.
• Strong experience in Big Data, Cloud Computing or related tech domains.
• Experience with large-scale enterprise data platforms and production pipelines.
• Strong programming and SQL skills.
• Experience with cloud-based data engineering and modern data processing frameworks.
• Experience with AI/ML, NLP or Generative AI advantageous.

Responsibilities

• Design, develop and maintain scalable ETL/ELT data pipelines for large-volume datasets.
• Develop high-performance data processing solutions using Python, PySpark, Spark, Scala.
• Build batch and real-time data pipelines using Kafka, Kinesis, Spark Streaming, AWS Glue and Airflow.
• Develop data ingestion frameworks integrating RDBMS, APIs, files, cloud storage and streaming platforms.
• Design and implement data lakes, data warehouses and cloud-based processing platforms.
• Work with Databricks, Hadoop, Hive, Cloudera, Presto and Snowflake for large-scale processing and analytics.
• Perform data modelling, data transformation, data quality, query optimisation and performance tuning.
• Develop and optimise SQL across Oracle, SQL Server, PostgreSQL, Teradata, MongoDB and cloud databases.
• Design and implement data migration solutions for large-scale datasets.
• Develop and support real-time and batch processing architectures.
• Integrate data platforms with REST APIs, GraphQL and enterprise apps.
• Implement CI/CD and DevOps using Jenkins, Git, Docker, Kubernetes and OpenShift.
• Develop cloud-native data solutions using AWS and Azure (S3, Glue, EMR, Redshift, Kinesis, Lambda, RDS, DynamoDB).
• Develop AI/GenAI-enabled data solutions involving LLMs, NLP, RAG, Agentic AI and vector databases.
• Integrate LLM services and AI platforms like Azure OpenAI, OpenAI APIs, Hugging Face and Google Gemini/ADK.
• Develop NLP pipelines for text processing, embeddings, summarisation, sentiment analysis, voice-to-text and speaker diarisation.
• Design and implement vector search and retrieval using Redis, ChromaDB and FAISS.
• Develop AI-powered APIs and apps using FastAPI, Gradio and Python.
• Collaborate with architects, data scientists, software engineers, business analysts and product teams.

Skills

Data engineering

Python

Spark

SQL

Cloud computing

AI/NLP

DevOps

REST APIs

Education

Bachelor's or Master's in CS/IT

Tools

Databricks

Hadoop

Kafka

Airflow

Docker

Kubernetes

OpenShift

Job description

JEET ANALYTICS PTE. LTD. is seeking a skilled Data Engineer to design, build and optimize scalable ETL/ELT data pipelines for large-scale datasets. You will work with Python, PySpark, Spark SQL, Scala and cloud services to deliver batch and real-time processing solutions.

The role requires strong SQL capabilities and experience with Databricks, Hadoop, Kafka and Airflow, plus AI/NLP competencies. Join a fast-moving team delivering enterprise data platforms in a Singapore-based environment.