Data Engineer

Accenture in the Philippines; Philippines; On-site; PHP 600,000 - 900,000; Full time

Job summary

Accenture in the Philippines is seeking a Data Engineer to design, develop, and maintain data solutions supporting data generation, collection, and processing. You will build data pipelines, ensure data quality, and implement ETL processes to migrate data across systems.

You will optimize queries, design scalable pipelines using Spark within Databricks, and collaborate with cross-functional teams to translate requirements into technical specifications.

Qualifications

• 2+ years of experience with Databricks Unified Data Analytics Platform.
• Strong knowledge of data pipeline architecture and ETL/ELT processes.
• Experience with cloud-based data platforms and distributed computing.

Responsibilities

• Design, develop and maintain data pipelines for data generation and processing.
• Optimize queries and implement snowflake schema and dimensional tables.
• Collaborate with cross-functional teams to gather requirements and translate into technical specs.
• Monitor, optimize and document data workflows for performance and reliability.
• Stay updated on industry trends and best practices in data engineering.

Skills

Databricks platform

Data pipelines

ETL/ELT

Apache Spark

Unity Catalog

Tools

Databricks

Spark

Job description

Job Description:

Design, develop and maintain data solutions for data generation, collection, and processing. Create data pipelines, ensure data quality, and implement ETL (extract, transform and load) processes to migrate and deploy data across systems.

Summary: As a Data Engineer, you will design, develop, and maintain data solutions that facilitate data generation, collection, and processing. Your typical day will involve creating data pipelines, ensuring data quality, and implementing ETL processes to migrate and deploy data across various systems. You will collaborate with team members to enhance data workflows and contribute to the overall efficiency of data management practices.

Roles & Responsibilities:

• Optimize queries for speed and efficiency, design and implement snowflake schema and create fact dimension tables
• Design, develop, and maintain scalable data pipelines using Apache Spark within Databricks. Build batch and streaming data workflows.
• Implement ETL/ELT processes to transform raw data into curated datasets.
• Implement data access controls and permissions using Unity Catalog
• Required active participation/contribution in team discussions
• Collaborate with cross-functional teams to gather requirements and translate them into technical specifications
• Monitor and optimize data pipelines for performance and reliability
• Document data processes and workflows to ensure clarity and knowledge sharing within the team
• Stay updated with industry trends and best practices in data engineering to continuously improve processes

Professional & Technical Skills:

• Required Skill: Expert proficiency in Databricks Unified Data Analytics Platform
• Strong knowledge of data pipeline architecture and implementation
• Experience with data integration and transformation techniques
• Familiarity with cloud-based data platforms and distributed computing
• Ability to troubleshoot and resolve data-related issues efficiently
• Proficient in optimizing data workflows for scalability and performance

Additional Information:

• The candidate should have minimum 2 years of experience in Databricks Unified Data Analytics Platform
• This position is based at our Manila office
• Minimum 2 year(s) of experience is required

Requirements: