Senior Azure Databricks Architect

Intellibee Inc; Jersey City (NJ); On-site; USD 150,000 - 210,000; Full time

Benefits offered by this job

Long-Term Stability

Comprehensive Health Coverage

401(k) program

Green Card assistance

Job summary

IntelliBee in Jersey City, NJ seeks a Senior Azure Databricks Engineer to design, implement, and evolve a scalable Databricks data platform. You will work with data and technology teams to build data solutions using Databricks and Microsoft Azure, focusing on data engineering, integration, security, automation, and platform best practices.

Ideal candidates bring hands-on experience with Databricks Workspace, Unity Catalog, Delta Lake, Spark, and MLflow, plus Azure Data Factory and ADLS Gen2.

Qualifications

• Hands-on Databricks experience with Azure integration.
• Strong data engineering and ETL/ELT skills.
• Experience in large enterprise environments with governance.

Responsibilities

• Design, implement, and evolve the Databricks data platform.
• Collaborate with data and technology teams to build scalable data solutions.
• Ensure security, automation, and platform best practices.

Skills

Databricks

Python

Azure

Spark

CI/CD

Security

Tools

Git

OpenShift

Kubernetes

Terraform

Airflow

Job description

IntelliBee in Jersey City, NJ seeks a Senior Azure Databricks Engineer to design, implement, and evolve a scalable Databricks data platform. You will work with data and technology teams to build data solutions using Databricks and Microsoft Azure, focusing on data engineering, integration, security, automation, and platform best practices.

Ideal candidates bring hands-on experience with Databricks Workspace, Unity Catalog, Delta Lake, Spark, and MLflow, plus Azure Data Factory and ADLS Gen2.