Azure Data Engineer

NLB Services; New York (NY); On-site; USD 120,000 - 150,000; Full time

Job summary

A tech services company seeks a Senior Data Engineer in New York, specializing in scalable data pipelines and analytics platforms within the healthcare domain. Ideal candidates will have extensive experience with Microsoft Azure and MS SQL Server, alongside strong knowledge of healthcare data compliance. Responsibilities include designing data ingestion workflows and collaborating with analytics teams. This crucial role requires problem-solving abilities and a solid understanding of healthcare systems. Competitive salary and comprehensive benefits offered.

Qualifications

• 5+ years of experience in data engineering or related roles.
• Proven experience working with healthcare data and systems.
• Strong problem-solving skills and ability to work independently.

Responsibilities

• Design and maintain scalable data pipelines using Azure tools.
• Develop backend services and data-processing components using Golang.
• Ensure data quality and compliance with HIPAA standards.

Skills

MS SQL Server

Microsoft Azure

Go (Golang)

Healthcare domain experience

Education

Bachelor’s or Master’s degree in Computer Science or related field

Tools

Azure Data Factory (ADF)

Azure Synapse Analytics

Azure Data Lake

Power BI

PySpark

Job description

We are looking for a skilled Senior Data Engineer with strong experience in building scalable data pipelines and analytics platforms on Microsoft Azure, specifically within the healthcare domain. The ideal candidate will have hands-on expertise with modern data engineering tools and a solid understanding of healthcare data, compliance, and regulatory requirements.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Data Factory (ADF) and Azure Synapse Analytics.
• Build and manage data ingestion and transformation workflows using PySpark.
• Develop and optimize data storage solutions using Azure Data Lake.
• Work extensively with MS SQL Server for data modeling, querying, and performance tuning.
• Develop backend services and data-processing components using Go (Golang) where applicable.
• Work with healthcare data such as claims, clinical, member, or provider data.
• Ensure data quality, reliability, security, and performance while adhering to HIPAA and healthcare compliance standards.
• Collaborate with analytics, product, and business teams to deliver healthcare-focused data solutions.
• Monitor, troubleshoot, and optimize production data workflows.
• Follow best practices for cloud security, scalability, and cost optimization.

Must-Have Skills

• Strong experience with MS SQL Server
• Hands-on experience with Microsoft Azure
• Go (Golang) for backend or data services development
• Mandatory: Prior experience in the Healthcare domain

Nice-to-Have Skills

• Experience with Power BI for reporting and data visualization
• Exposure to CI/CD pipelines and DevOps practices
• Experience with large-scale, distributed data systems

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field
• 5+ years of experience in data engineering or related roles
• Proven experience working with healthcare data and systems
• Strong problem-solving skills and ability to work independently
• Excellent communication and collaboration skills