Data Engineer (Databricks)

RISKDATA CONSULTING PTE. LTD.; Singapore; On-site; SGD 90,000 - 120,000; Full time

Job summary

A leading consulting firm in Singapore is seeking an experienced Project Manager to lead data engineering and cloud transformation initiatives. The role requires strong expertise in Databricks, project planning, and effective stakeholder management. Key responsibilities include managing the project lifecycle and driving implementations within Azure or AWS environments. Ideal candidates will have 7+ years of experience, particularly in data or cloud platforms, and possess strong communication skills.

Qualifications

• 7+ years of total experience with 2+ years in cloud platform project management.
• Proficiency in Databricks features such as lakehouse architecture and workflows.
• Experience with Azure or AWS environments.

Responsibilities

• Lead and manage full project lifecycle for data platform initiatives.
• Collaborate with teams to gather requirements and define project scope.
• Manage vendor coordination, resource allocation, and budgeting.

Skills

Project management in cloud environments

Data engineering concepts

Agile/Scrum methodologies

Stakeholder management

Databricks exposure

Tools

JIRA

Azure DevOps

MS Project

Job description

We are seeking an experienced Project Manager with strong Databricks exposure to lead end-to-end data engineering, analytics, and cloud transformation initiatives. The ideal candidate will have demonstrated expertise in managing cross-functional teams, delivering data platform projects, and working closely with technical teams using Databricks, Azure/AWS, and modern data architectures.

Key Responsibilities

• Lead and manage full project lifecycle for data platform, analytics, and ML pipeline initiatives using Databricks.
• Collaborate with data engineers, architects, BI teams, and business stakeholders to gather requirements, define scope, and translate business needs into detailed project plans.
• Drive Databricks-based implementation including workspace setup, lakehouse integration, ETL/ELT pipelines, and data governance workflows.
• Oversee Agile ceremonies (sprint planning, grooming, stand-ups, retrospectives) and maintain delivery cadence using JIRA/ADO.
• Ensure strong project tracking, risk management, and stakeholder communication through structured reporting, dashboards, and documentation.
• Manage vendor coordination, resource allocation, and budgeting for data platform and cloud projects.
• Ensure all deliverables meet security, compliance, and data quality standards, collaborating with cloud, InfoSec, and architecture teams.
• Support UAT, deployment, and post-production stabilization activities.
• Promote best practices for Databricks governance, cluster optimization, cost management, and workspace operations.

Skills Required

• 7+ years of total experience with 2+ years in data or cloud platform project management.
• Hands‑on exposure to Databricks (lakehouse architecture, notebooks, clusters, jobs, workflows).
• Strong understanding of data engineering concepts, ETL/ELT pipelines, Delta Lake, and data governance.
• Experience delivering projects on Azure or AWS cloud environments.
• Expertise in project planning, Agile/Scrum, and standard PM frameworks (PMP/Prince2 preferred).
• Strong communication, stakeholder management, and cross‑functional leadership skills.
• Proficiency with JIRA, Azure DevOps, Confluence, MS Project, or similar tools.

Nice-to-Have Skills

• Knowledge of Spark, PySpark, SQL, or data modelling concepts.
• Exposure to MLflow, Unity Catalog, or Databricks cost optimization.
• Certification in Databricks or cloud platforms (Azure/AWS/GCP).
• Experience working in large enterprise or regulated environments (BFSI, Healthcare, Retail).