Senior Azure Databricks Engineer

FUSTIS LLC; Jersey City (NJ); Hybrid; USD 140,000 - 210,000; Full time

Job summary

FUSTIS LLC is seeking a Senior Azure Databricks Engineer to design, develop, optimize, and support enterprise-scale data engineering solutions using Azure Databricks and the Microsoft Azure stack. The role emphasizes production-grade data pipelines, security-conscious design, and collaboration with enterprise teams.

The ideal candidate will drive performance tuning, data governance, and scalable data workflows in a hybrid Jersey City environment, with onsite interviews and a 12-month engagement.

Qualifications

• Strong hands-on experience with Azure Databricks, Databricks Workspace, Unity Catalog, Delta Lake, Apache Spark, and Spark UI.
• Expertise in Python, PySpark, SQL, and ETL/ELT pipeline development.
• Experience with ADLS Gen2 and Azure Data Factory.
• Strong Spark performance tuning, troubleshooting, and production support experience.
• Experience with Databricks security, access controls, secrets management, identity integration, and data governance.
• Knowledge of Git, CI/CD, Terraform/IaC, Kubernetes, and OpenShift.
• Experience with Databricks workflows, job orchestration, monitoring, and automation.
• Knowledge of MLflow and Apache Airflow.
• Experience with enterprise architecture, security, and change-management standards.

Responsibilities

• Design, develop, optimize, and support enterprise-scale data engineering solutions using Azure Databricks.
• Provide production support, performance tuning, and monitoring for data pipelines and workloads.

Skills

Azure Databricks

Databricks Workspace

Unity Catalog

Delta Lake

Apache Spark

Spark UI

Python

PySpark

SQL

ETL/ELT pipelines

ADLS Gen2

Azure Data Factory

Spark tuning

CI/CD

Terraform/IaC

Kubernetes

OpenShift

Databricks security

Data governance

Git

Monitoring

Workflow orchestration

MLflow

Apache Airflow

Tools

Git

CI/CD pipelines

Terraform

Job description

Location: Jersey City, NJ – Hybrid (Local Candidates Only)

Duration: 12 Months

Work Authorization: USC and Green Card Holders Only

Interview: Onsite

Job Description:

We are seeking a Senior Azure Databricks Engineer to design, develop, optimize, and support enterprise-scale data engineering solutions using Azure Databricks and Microsoft Azure.

Required Skills:

• Strong hands‑on experience with Azure Databricks, Databricks Workspace, Unity Catalog, Delta Lake, Apache Spark, and Spark UI.
• Expertise in Python, PySpark, SQL, and ETL/ELT pipeline development.
• Experience with Azure Data Lake Storage Gen2 (ADLS Gen2) and Azure Data Factory (ADF).
• Strong Spark performance tuning, troubleshooting, and production support experience.
• Experience with Databricks security, access controls, secrets management, identity integration, and data governance.
• Knowledge of Git, CI/CD, Terraform/IaC, Kubernetes, and OpenShift.
• Experience with Databricks workflows, job orchestration, monitoring, and automation.
• Knowledge of MLflow and Apache Airflow.
• Experience working with enterprise architecture, security, and change‑management standards.

Preferred:

AWS S3/IAM, MLOps, and production‑grade enterprise Databricks platform implementation.

Submission Requirements:

• Local candidates in the Jersey City, NJ area only.
• Resume must be 3 pages or fewer.
• Include a LinkedIn profile with a picture and full name.
• Candidates must be available for an onsite interview.