Databricks Data Engineer - Pipelines & Quality Lead

PERSOL; Santo Niño 1st; On-site; PHP 600,000 - 1,000,000; Full time

Job summary

PERSOL in the Philippines is seeking an experienced Data Engineer to design, develop, and maintain data solutions for data generation, collection, and processing. You will build data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems.

The role requires expertise in Databricks, data ingestion, processing, and migration, plus the ability to translate data requirements into practical technical solutions and collaborate with multiple teams.

Qualifications

• 2+ years in data engineering, data development or related areas, with experience in DataBricks.
• Experience designing, developing and maintaining data solutions, data pipelines and ETL processes.
• Familiarity with Databricks or similar data and analytics platforms.
• Experience with data ingestion, processing, migration and deployment across systems.
• Experience monitoring and optimising data pipelines for performance and reliability.
• Experience performing data quality checks and implementing improvements.
• Ability to translate data requirements into practical technical solutions.

Responsibilities

• Design, develop, and maintain data solutions for data generation, collection, and processing.
• Create data pipelines, ensuring data quality, and implement ETL processes to migrate and deploy data across systems.
• Be a subject matter expert, collaborate and manage the team to perform effectively.
• Contribute to key decisions while providing solutions to problems for your immediate team and across multiple teams.
• Develop innovative data solutions that enhance data accessibility and usability.
• Collaborate with cross-functional teams to identify data needs and implement effective solutions.
• Monitor and optimise data pipelines for performance and reliability.
• Conduct regular data quality assessments and implement improvements as necessary.
• Stay updated with industry trends and best practices in data engineering to continuously improve processes.

Skills

Data engineering

Databricks

ETL processes

Data pipelines

Data quality checks

Data migration

Problem solving

Tools

Databricks

Job description

PERSOL in the Philippines is seeking an experienced Data Engineer to design, develop, and maintain data solutions for data generation, collection, and processing. You will build data pipelines, ensure data quality, and implement ETL processes to migrate and deploy data across systems.

The role requires expertise in Databricks, data ingestion, processing, and migration, plus the ability to translate data requirements into practical technical solutions and collaborate with multiple teams.