Databricks Engineer - Azure Data Lake & Cybersecurity

Sharp Decisions; Jersey City (NJ); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Hybrid work model

Job summary

Sharp Decisions in Jersey City, NJ, is seeking a senior data engineering contractor to design, develop, and deploy cloud data solutions within a cybersecurity data lake initiative. You will build data feeds, ensure data quality, and collaborate across IT stakeholders to align KDEs with data models.

The role emphasizes Databricks, Azure cloud services, Python/Java, and strong governance; you will mentor junior team members, participate in architecture discussions, and help scale data pipelines

Qualifications

• Azure cloud data platform experience with Databricks.
• Strong data governance and KDE/data quality knowledge.
• Experience designing data ingestion and performance tuning.

Responsibilities

• Design, develop, test, and support cloud data solutions for cybersecurity data.
• Lead data feed development and mentor junior team members.
• Coordinate integration of applications within the data ecosystem.
• Document KDEs and align to logical/physical data models.
• Collaborate with data owners to define metrics for dashboards.
• Establish data views for downstream consumption and enforce DQ rules.
• Work with scheduling and batch monitoring of production jobs.
• Resolve data quality issues and improve procedures.

Skills

Azure Databricks

Unity Catalog

Azure Data Factory

Azure Data Lake Storage

Azure Functions

Azure Event Grid

Azure Log Analytics

Development & Data Engineering

Python / Java

SQL Server

Oracle / PL-SQL

T-SQL

ETL / ELT

REST API

CI/CD

Collibra DQIM

IBM Infosphere DA

Job description

Sharp Decisions in Jersey City, NJ, is seeking a senior data engineering contractor to design, develop, and deploy cloud data solutions within a cybersecurity data lake initiative. You will build data feeds, ensure data quality, and collaborate across IT stakeholders to align KDEs with data models.

The role emphasizes Databricks, Azure cloud services, Python/Java, and strong governance; you will mentor junior team members, participate in architecture discussions, and help scale data pipelines