Remote Senior Azure Databricks Engineer | Data & ETL

Altamira for freelancers; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Fully remote

Tech equipment provided

Paid vacation

Job summary

Altamira is seeking a highly technical Senior Azure Databricks Engineer to take ownership of optimizing and productionizing Databricks workloads for a major reinsurance client. You will design data processes, develop and version data models, and work with Azure cloud-based data infrastructures.

Responsibilities include developing and executing schema migrations and optimizing ETL performance, while leveraging data warehouse and transactional modeling concepts.

Qualifications

• Must have proficiency in Databricks, Delta Lake, Python, PowerShell, MS SQL Server, and T-SQL.
• Azure Stack: strong knowledge of Azure Data Factory, Azure Data Lake, and Cosmos DB.
• DevOps: experience with Azure DevOps, Git, Visual Studio, testing, and optimizing complex data flows.
• Data modeling: solid understanding of data warehouse and transactional modeling concepts.
• Should-Have: experience with Power BI.

Responsibilities

• Design and implement data processes (e.g., ADF Pipelines, Databricks).
• Develop and version data models.
• Work with Azure cloud-based data infrastructures.
• Develop and execute schema and data migrations.
• Optimize ETL performance.

Skills

Databricks

Delta Lake

Python

PowerShell

MS SQL Server

T-SQL

Data modeling

Power BI

Tools

Azure Data Factory

Azure Data Lake

Cosmos DB

Azure DevOps

Git

Visual Studio

Job description

Altamira is seeking a highly technical Senior Azure Databricks Engineer to take ownership of optimizing and productionizing Databricks workloads for a major reinsurance client. You will design data processes, develop and version data models, and work with Azure cloud-based data infrastructures.

Responsibilities include developing and executing schema migrations and optimizing ETL performance, while leveraging data warehouse and transactional modeling concepts.