Data Engineer Databricks

NCS; Taguig; On-site; PHP 500,000 - 900,000; Full time

Job summary

NCS in Taguig, Philippines is seeking a data engineer to design, build, and maintain automated ETL pipelines in the Data Lake. You will collaborate with multiple teams to deliver pipelines on time and prepare deployment packages for testing and production readiness.

The role requires strong Python and SQL skills, hands-on experience with Databricks or Snowflake, and exposure to Azure or AWS. Excellent communication and teamwork are essential in a fast-paced environment with tight SLAs.

Qualifications

• Proficient in Python (4/5) and SQL (3/5).
• Experience with modern data cloud platforms like Databricks or Snowflake.
• Exposure to cloud services (Azure or AWS).
• Strong SQL & PL/SQL skills; able to solve complex challenges.

Responsibilities

• Assess and estimate effort based on business request form.
• Develop and deliver automated ETL data pipelines in the Data Lake within timelines.
• Coordinate with support groups to complete automated data pipelines.
• Prepare deployment package for Release Testing Team, including design doc and operations guide.
• Support stabilization in production and approve builds per framework and standards.
• Document source code.
• Perform other duties as assigned.

Skills

Python

SQL

Communication

Team collaboration

Tools

Databricks

Snowflake

Azure

AWS

Job description

• Provides assessment and estimation of effort needed based on the provided Business request form.
• Develops and delivers automated data pipelines (Extract, Transform, Load-ETL) jobs in the Data Lake within expected timelines.
• Coordinates with various support groups to accomplish assigned automated data pipes for development
• Prepares deployment package for endorsement to Release Testing Team which includes Solutions Design Document and Operations Guide.
• Provides support during the stabilization phase of pipes endorsed to production until declared BAUeview and approves builds based on the set framework, standards, and best practices.
• Documents source code.
• Other job-related activities that may be assigned from time to time.

Minimum Qualifications

• Skilled in Python (atleast 4/5 rating), SQL (atleast 3/5 rating)
• Working or has experience working on modern data cloud platforms ( Databricks/Snowflake)
• With exposure to cloud services (preferably Azure or AWS)
• Must have strong SQL & PL/SQL skills with the ability to solve highly complex challenges
• Must have good communication and interpersonal skills for interacting and collaborating with developers, analysts, and business staff throughout the organization.
• Must have the ability to communicate clearly in writing to document data requirements and translate them into technical solutions.
• Must be adept to work in a fast-paced environment with tight SLAs.