Azure Databricks Data Engineer — Hybrid & Flexible

HIGH BRIDGE CONSULTING LLC; New York (NY); Híbrido; USD 120.000 - 180.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Flexible work from home options

Descripción de la vacante

HIGH BRIDGE CONSULTING LLC seeks an experienced Data Engineer - Azure Databricks to design and build scalable data solutions for enterprise analytics across RESO, HCG, Compliance, Facilities, and Finance. Hybrid NYC area role with 3 days onsite weekly.

The ideal candidate has strong Azure, Databricks, Spark, SQL, Python/Scala, and data integration skills to align data architectures with business strategies and governance standards.

Formación

• Bachelor's degree or equivalent experience in CS/IS/Engineering
• 5+ years of data engineering experience
• Strong hands-on experience with Microsoft Azure data services
• Extensive experience with Azure Databricks, including Apache Spark and distributed data processing
• Advanced SQL development and optimization in large-scale environments
• Experience building/orchestrating data pipelines using Azure Data Factory or similar tools
• Strong experience with Azure SQL Database, including performance tuning
• Proficiency in Python and/or Scala for data engineering and automation
• Experience with C# and PowerShell for integration and automation tasks
• Experience developing and deploying Azure Functions for data processing
• Experience integrating APIs, event-driven architectures, and enterprise applications
• Understanding of scalable, secure, cloud-native data architectures
• Excellent communication and collaboration skills across domains

Responsabilidades

• Design, develop, and maintain scalable data pipelines using Microsoft Azure and Azure Databricks
• Build and optimize ETL/ELT processes for structured and unstructured data sources
• Partner with stakeholders across corporate functions to gather requirements and deliver data-driven solutions
• Design and implement data models, architectures, and frameworks supporting reporting, analytics, and BI
• Integrate enterprise platforms such as ServiceNow, Dataverse, Workday into centralized data environments
• Ensure adherence to data quality, governance, security, and compliance standards
• Monitor, troubleshoot, and optimize data workflows for high availability and performance
• Contribute to ongoing enhancement of enterprise data platforms and best practices
• Support data modernization initiatives and enterprise analytics strategies

Conocimientos

Data Engineering

Azure Data Services

SQL

Python

Scala

C#

PowerShell

Azure Functions

Educación

Bachelor's degree in Computer Science/Information Systems/Engineering

Herramientas

Azure Databricks

Apache Spark

Azure Data Factory

Azure SQL Database

Delta Lake

Descripción del empleo

HIGH BRIDGE CONSULTING LLC seeks an experienced Data Engineer - Azure Databricks to design and build scalable data solutions for enterprise analytics across RESO, HCG, Compliance, Facilities, and Finance. Hybrid NYC area role with 3 days onsite weekly.

The ideal candidate has strong Azure, Databricks, Spark, SQL, Python/Scala, and data integration skills to align data architectures with business strategies and governance standards.