Senior Data Engineer - Azure Databricks & Delta Lake

Akaasa Technologies

Houston (TX)

On-site

USD 120,000 - 180,000

Part time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Job summary

Akaasa Technologies in Houston, TX seeks a Senior Data Engineer with deep hands-on expertise in Azure Databricks to design, develop, and manage enterprise-scale data platforms, using Delta Lake, PySpark, SQL and Scala to build scalable pipelines and modern data architectures.

You will migrate legacy workflows to Databricks-based solutions, implement data governance with Unity Catalog, and operate production pipelines with Databricks Workflows and Jobs, plus CI/CD automation through Azure DevOps.

Qualifications

Strong hands-on experience with Azure Databricks engineering and development.
Experience building data pipelines using PySpark, SQL, Scala, Delta Lake.
Knowledge of Databricks Workflows/Jobs for production orchestration and Unity Catalog governance.

Responsibilities

Design, develop, and optimize end-to-end data pipelines using Azure Databricks, Delta Lake, PySpark, SQL and Scala.
Build and manage production workflows using Databricks Workflows and Jobs for orchestration.
Lead migration of legacy data platforms to Databricks-based architectures.
Convert legacy ETL workflows into scalable PySpark/SQL solutions.
Implement data governance, security, and lineage using Unity Catalog.
Develop and maintain CI/CD processes for Databricks deployments via Azure DevOps and YAML pipelines.