Big Data Engineer - PySpark & Scala for Real-Time Pipelines

Tata Consultancy Services Limited; Singapore; On-site; SGD 90,000 - 150,000; Full time

Job summary

Tata Consultancy Services Limited in Singapore is seeking a highly skilled Big Data Engineer with strong PySpark and Scala to design, build, and optimize large-scale data processing systems across enterprise data ecosystems. You will develop scalable data pipelines, data lakes, and streaming solutions on distributed platforms, enabling real-time and batch analytics, data quality, and governance.

The role emphasizes collaboration with cross-functional teams and delivery of robust data solutions

Qualifications

• Strong PySpark + Scala coding
• Deep big data architecture knowledge
• Hands-on experience with streaming + cloud data engineering
• Knowledge of data compliance and regulatory reporting

Responsibilities

• Design and develop scalable data pipelines using PySpark and Scala
• Data Platform & Architecture
• Data Processing & Optimization
• Streaming & Real-Time Data
• Cloud & Modern Data Stack
• Data Quality & Governance
• Collaboration & Delivery

Skills

PySpark

Scala programming

SQL

Python

Unix

Tools

Kafka

Sqoop

Airflow

Docker

Kubernetes

Git

CI/CD

Job description

Tata Consultancy Services Limited in Singapore is seeking a highly skilled Big Data Engineer with strong PySpark and Scala to design, build, and optimize large-scale data processing systems across enterprise data ecosystems. You will develop scalable data pipelines, data lakes, and streaming solutions on distributed platforms, enabling real-time and batch analytics, data quality, and governance.

The role emphasizes collaboration with cross-functional teams and delivery of robust data solutions