Databricks Developer

GlobalPoint; Raritan (NJ); On-site; USD 120,000 - 150,000; Full time

Job summary

GlobalPoint in Raritan, New Jersey is seeking a Senior Data Engineer to lead the design, development, and optimization of data solutions on Azure Databricks. This role involves implementing end-to-end data pipelines, optimizing data workflows, and collaborating with stakeholders to translate requirements into data solutions.

The ideal candidate should possess a strong background in Azure, Databricks, and data governance. This is a 6-month contract with potential for extension.

Qualifications

• Strong experience in designing and developing data pipelines.
• Proficiency in Azure, Databricks, and Azure Data Lake.
• Ability to collaborate with cross-functional teams.

Responsibilities

• Lead end-to-end data pipeline development on Azure.
• Implement scalable ETL/ELT for various data types.
• Optimize workflows for performance and reliability.

Job description

Overview

Duration: 6 Months+ Senior Data Engineer to lead the design, development, and optimization of data solutions on Azure Databricks

• Lead the design and development of end-to-end data pipelines on Azure, leveraging Databricks, Azure Data Lake, and ADLS Gen 2.
• Implement scalable ETL/ELT pipelines for structured, semi-structured, APIs, and unstructured data.
• Collaborate with Data Scientists, Business Analysts, and other stakeholders to translate business requirements into robust data solutions.
• Optimize data workflows for performance, reliability, and cost-efficiency in cloud environments.
• Establish and enforce data quality, governance, and validation standards.
• Provide guidance on data modeling, schema design, and metadata management to support analytics and AI workloads.
• Monitor and troubleshoot production data pipelines and recommend performance improvements.
• Evaluate emerging Azure and Databricks technologies and propose enhancements to our data architecture.