#EX Data Engineer (Databricks)

NCS; Singapore; On-site; SGD 90,000 - 130,000; Full time

Job summary

NCS is hiring a Data Engineer in Singapore to design, develop, and maintain scalable data pipelines on Databricks and cloud platforms. You will integrate diverse data sources and support analytics, reporting, and ML workloads while upholding governance and reliability standards.

You will collaborate with analytics, product, and infra teams to advance the data platform, implement monitoring, and optimise ETL performance across batch and streaming workloads.

Qualifications

• 3+ years in data engineering with scalable pipelines.
• Experience in data modelling and distributed computing.
• Hands-on with PySpark, Spark SQL and Databricks notebooks/jobs.
• Experience orchestrating data pipelines with ADF, Airflow, or similar tools.
• Experience with real-time and batch data processing.
• Proficiency in SQL and performance optimization.
• DevOps, Git workflows, and CI/CD familiarity.
• Scrum experience and ability to work in Scrum teams.
• Exposure to streaming tech like Kafka, Flink, or Kinesis.
• Databricks Certified Data Engineer Associate/Professional preferred.

Responsibilities

• Develop and maintain ETL pipelines for centralized data storage (Delta Lake).
• Integrate data from databases, APIs, logs, and external providers.
• Design data transformations to clean, normalize, and aggregate data.
• Implement data governance and reliability practices.
• Collaborate with analytics, product, and infra teams to enhance data platform.
• Build dashboards, reports, and data visualizations.
• Monitor pipelines and implement error-handling and alerts.
• Work on cloud-based data platforms, primarily Azure.
• Participate in requirement grooming and UAT for data projects.
• Support production deployment and data validation activities.

Skills

Data modelling

Distributed computing

PySpark

Spark SQL

Databricks

SQL proficiency

DevOps & CI/CD

Scrum methodolgy

Streaming tech

Real-time processing

Tools

Azure

ADF

Airflow

Kafka

Flink

Kinesis

Job description

NCS is a leading AI Tech Services company. With a 15,000-strong team across the Asia Pacific, NCS scales its platforms and capabilities to provide clients with greater agility and AI expertise across a range of Industries. Embracing a strong ecosystem of global partners, NCS transforms technology services delivery combining AI with digital resilience to drive real business impact. NCS is a subsidiary of the Singtel Group.

Job Description

The Data Engineer will be responsible for designing, developing, and maintaining scalable and reliable data pipelines on Databricks and cloud platforms. The role requires integrating diverse data sources, ensuring high-quality data processing, and supporting analytics, reporting, and machine learning workloads. The role involves collaborating closely with analytics, product, and infrastructure teams to enhance the company’s data platform while adhering to best practices for governance, monitoring, and reliability.

What will you do?

• Develop and maintain ETL pipelines for centralized data storage systems (e.g. Delta Lake).
• Integrate data from databases, APIs, log files, streaming platforms, and external providers
• Develop data transformation routines to clean, normalize, and aggregate data
• Apply data processing techniques to handle complex or inconsistent datasets
• Contribute to frameworks and best practices for code development and deployment
• Implement data governance in alignment with company standards
• Partner with analytics and product leaders to design and operationalize pipelines
• Collaborate with infrastructure leaders to advance cloud-based data platforms
• Explore new tools and techniques leveraging Azure, Databricks, or related platforms
• Monitor data pipelines to detect and resolve issues promptly
• Develop monitoring tools, alerts, and automated error-handling mechanisms
• Analyse business requirements and identify data extraction requirements
• Attend requirement grooming and refinement sessions with users
• Develop and maintain ETL pipelines for ingestion, transformation, validation, and loading
• Optimise performance and batch scheduling
• Develop dashboards, reports, scorecards, and data visualizations
• Perform SIT, data validation, data profiling and confirm data accuracy
• Validate completeness and consistency of ETL Loads
• Support UAT and production implementation

Qualifications

The ideal candidate should possess:

• 3 or more years of experience in data engineering with scalable pipelines
• Strong experience designing data solutions including data modelling anddistributed computing architectures
• Hands-on experience with data processing jobs using PySpark,Spark SQL, and Databricks notebooks/jobs
• Experience orchestrating data pipelines with ADF, Airflow, or similar tools
• Experience with both real-time and batch data processing
• Experience building pipelines on Azure, with AWS experience beneficial
• Proficiency in SQLincluding window functions and performance optimization
• Understanding of DevOps tools, Git workflows, and CI/CD pipelines
• Familiarity with Scrum methodology and experience working in Scrum teams
• Ability to apply Scrum practices in a practical project context
• Strong problem-solving and collaborative mindset
• Experience with streaming technologies such as Apache Kafka, Apache Flink, or AWS Kinesis
• Ability to design and implement real-time data processing pipelines

Must haveDatabricks Certified Data Engineer Associate and Databricks Certified Data Engineer Professionalis stronglypreferred

Additional Information

We are driven by our AEIOU beliefs—Adventure, Excellence, Integrity, Ownership, and Unity—and we seek individuals who embody these values in both their professional and personal lives. We are committed to our Impact: Valuing our clients, Growing our people, and Creating our future.

Together, we make the extraordinary happen.

Learn more about us at ncs.co and visit our LinkedIn career site.