Remote Azure Databricks Data Engineer (ETL & Delta Lake)

Exavalu; Hinoba-an; On-site; PHP 700,000 - 1,100,000; Full time

Job summary

Exavalu is seeking a Remote Data Engineer to design and optimize data pipelines using Azure Databricks, Spark, and SQL. The role focuses on data processing, transformation, and Aurora-like storage management within a modern Azure data stack.

You will implement Delta Lake for data versioning, integrate with Azure Data Factory and Synapse for orchestration and warehousing, and ensure data security through RBAC and encryption while optimizing performance and costs.

Qualifications

• Hands-on experience with Azure Data Factory, Synapse and Databricks.
• Strong Python and PySpark coding skills; SQL proficiency.

Responsibilities

• Design, build, and optimize robust ETL/ELT pipelines.
• Process, transform, and aggregate data for analytics.
• Manage and optimize data storage in ADLS Gen2.
• Implement Delta Lake for ACID compliance and versioning.
• Integrate Databricks with ADF, Synapse, and Key Vault for security.
• Monitor and optimize clusters and Spark jobs for cost and performance.
• Enforce RBAC, encryption, and data lineage governance.

Skills

Python

PySpark

SQL

Spark

Azure Databricks

Tools

Azure Data Factory

Azure Synapse Analytics

Delta Lake

Azure Data Lake Storage

Job description

Exavalu is seeking a Remote Data Engineer to design and optimize data pipelines using Azure Databricks, Spark, and SQL. The role focuses on data processing, transformation, and Aurora-like storage management within a modern Azure data stack.

You will implement Delta Lake for data versioning, integrate with Azure Data Factory and Synapse for orchestration and warehousing, and ensure data security through RBAC and encryption while optimizing performance and costs.