Data Engineer, Databricks & DevOps for Scalable Pipelines

COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD.

Singapore

Sur place

SGD 90 000 - 150 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Avantages offerts par ce poste

Databricks Workflows
CloudWatch Monitoring

Résumé du poste

Cognizant Technology Solutions Asia Pacific PTE. LTD. is seeking a Data Engineer to design, build, and maintain scalable data pipelines on AWS and Databricks. The role combines data engineering with DevOps practices to deliver automated, secure data platforms supporting analytics and ML.

Responsibilities include design of batch/streaming pipelines, lakehouse architecture, and orchestration with Airflow or Databricks Workflows. Strong Python/SQL, AWS, and CI/CD experience are essential.

Qualifications

  • Bachelor's degree in CS, Engineering, or related field.
  • Hands-on Databricks experience (PySpark, Delta Lake, Jobs/Workflows, cluster management).
  • Strong AWS skills: S3, IAM, Glue, Lambda, EC2, Kinesis/MSK, Redshift, VPC, CloudWatch.
  • Proficiency in Python and SQL.
  • Experience with Git, CI/CD pipelines, Docker, and infrastructure as code (Terraform preferred).
  • Understanding of data modeling, warehousing, and lakehouse concepts.
  • Experience with Airflow and Databricks Workflows.
  • Familiarity with Agile/Scrum delivery.

Responsabilités

  • Design and build scalable data pipelines on AWS and Databricks.
  • Develop batch and streaming ETL/ELT workflows.
  • Implement lakehouse architectures with Delta Lake and Unity Catalog.
  • Orchestrate workflows using Airflow or Databricks Workflows.
  • Provision cloud infrastructure with Terraform or CloudFormation.
  • Build CI/CD pipelines for data code and infra.
  • Monitor pipelines and platform health (CloudWatch, Datadog).
  • Optimize Spark jobs and cluster configs.
  • Enforce data quality, governance, security, and access controls.
  • Collaborate with data scientists, analysts, and stakeholders.
  • Document pipelines, architecture, and runbooks.

Connaissances

Databricks PySpark
Delta Lake
AWS services
Python
SQL
CI/CD
Git
Terraform
Airflow
Spark tuning
Data governance
DevOps practices

Formation

Bachelor's degree in Computer Science/Engineering

Outils

Databricks Workflows
Kubernetes
Airflow
Terraform
CloudFormation
GitHub Actions
Jenkins
Docker
Datadog
CloudWatch

Description du poste

Cognizant Technology Solutions Asia Pacific PTE. LTD. is seeking a Data Engineer to design, build, and maintain scalable data pipelines on AWS and Databricks. The role combines data engineering with DevOps practices to deliver automated, secure data platforms supporting analytics and ML.

Responsibilities include design of batch/streaming pipelines, lakehouse architecture, and orchestration with Airflow or Databricks Workflows. Strong Python/SQL, AWS, and CI/CD experience are essential.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Data Engineer - Databricks & AWS Data Pipelines
Data Engineer - Databricks & AWS Data Pipelines

EPS COMPUTER SYSTEMS PTE LTD • Singapore

Sur place
SGD 90 000 - 150 000
Data Engineer – Databricks & AWS Pipelines
Data Engineer – Databricks & AWS Pipelines

PERCEPT SOLUTIONS PTE. LTD. • Singapore

Sur place
SGD 90 000 - 130 000
Data Engineer (Databricks & DevOps)
Data Engineer (Databricks & DevOps)

COGNIZANT TECHNOLOGY SOLUTIONS ASIA PACIFIC PTE. LTD. • Singapore

Sur place
SGD 90 000 - 150 000
Databricks Workflows
CloudWatch Monitoring
AI-Driven Data Engineer: Databricks + AWS Pipelines
AI-Driven Data Engineer: Databricks + AWS Pipelines

PERSOL • Singapore

Sur place
SGD 90 000 - 130 000
Data Engineer (Databricks)
Data Engineer (Databricks)

BASIL TECHNOLOGIES PTE. LTD. • Singapore

Sur place
SGD 90 000 - 130 000
Databricks Data Engineer: Azure Pipelines & Real-Time Analytics
Databricks Data Engineer: Azure Pipelines & Real-Time Analytics

BASIL TECHNOLOGIES PTE. LTD. • Singapore

Sur place
SGD 90 000 - 130 000
Analytics Data Engineer - Databricks & AWS Pipelines
Analytics Data Engineer - Databricks & AWS Pipelines

FPT Asia Pacific • Singapore

Sur place
SGD 110 000 - 180 000
Senior Data Engineer: Build AWS/Databricks Pipelines
Senior Data Engineer: Build AWS/Databricks Pipelines

Epergne Solutions • Singapore

Sur place
SGD 120 000 - 180 000
Data Engineer (Databricks)
Data Engineer (Databricks)

NCS Pte Ltd • Singapore

Sur place
SGD 90 000 - 150 000
Data Engineer (Databricks)
Data Engineer (Databricks)

PERCEPT SOLUTIONS PTE. LTD. • Singapore

Sur place
SGD 90 000 - 130 000