Senior Azure Databricks Engineer - Hybrid Data Platform

FUSTIS LLC; Jersey City (NJ); Hybride; USD 140 000 - 210 000; Plein temps

Résumé du poste

FUSTIS LLC is seeking a Senior Azure Databricks Engineer to design, develop, optimize, and support enterprise-scale data engineering solutions using Azure Databricks and the Microsoft Azure stack. The role emphasizes production-grade data pipelines, security-conscious design, and collaboration with enterprise teams.

The ideal candidate will drive performance tuning, data governance, and scalable data workflows in a hybrid Jersey City environment, with onsite interviews and a 12-month engagement.

Qualifications

• Strong hands-on experience with Azure Databricks, Databricks Workspace, Unity Catalog, Delta Lake, Apache Spark, and Spark UI.
• Expertise in Python, PySpark, SQL, and ETL/ELT pipeline development.
• Experience with ADLS Gen2 and Azure Data Factory.
• Strong Spark performance tuning, troubleshooting, and production support experience.
• Experience with Databricks security, access controls, secrets management, identity integration, and data governance.
• Knowledge of Git, CI/CD, Terraform/IaC, Kubernetes, and OpenShift.
• Experience with Databricks workflows, job orchestration, monitoring, and automation.
• Knowledge of MLflow and Apache Airflow.
• Experience with enterprise architecture, security, and change-management standards.

Responsabilités

• Design, develop, optimize, and support enterprise-scale data engineering solutions using Azure Databricks.
• Provide production support, performance tuning, and monitoring for data pipelines and workloads.

Connaissances

Azure Databricks

Databricks Workspace

Unity Catalog

Delta Lake

Apache Spark

Spark UI

Python

PySpark

SQL

ETL/ELT pipelines

ADLS Gen2

Azure Data Factory

Spark tuning

CI/CD

Terraform/IaC

Kubernetes

OpenShift

Databricks security

Data governance

Git

Monitoring

Workflow orchestration

MLflow

Apache Airflow

Outils

Git

CI/CD pipelines

Terraform

Description du poste

FUSTIS LLC is seeking a Senior Azure Databricks Engineer to design, develop, optimize, and support enterprise-scale data engineering solutions using Azure Databricks and the Microsoft Azure stack. The role emphasizes production-grade data pipelines, security-conscious design, and collaboration with enterprise teams.

The ideal candidate will drive performance tuning, data governance, and scalable data workflows in a hybrid Jersey City environment, with onsite interviews and a 12-month engagement.