Data Engineer (Databricks & Azure)

Insight Global; Newtown Square (Delaware County); Hybrid; USD 79,900 - 89,544; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401k with employer matching

Paid time off

Job summary

A leading healthcare payor is seeking an Azure Data Engineer to spearhead data innovation efforts. This role includes designing and implementing end-to-end data solutions using Azure Databricks, converting SQL workflows to Python pipelines, and ensuring data quality and integrity. Collaboration is valued, requiring onsite attendance twice weekly. The compensation ranges from $58/hr to $65/hr with benefits including medical, dental, and 401k options starting on the 31st day of employment.

Qualifications

• Experience with Azure Databricks for data solutions.
• Strong Python skills for pipeline development.
• Familiarity with SQL and data pipeline optimization.

Responsibilities

• Design and implement data solutions using Azure Databricks.
• Convert legacy SQL workflows to Python-based pipelines.
• Maintain production-level data pipelines accurately.

Skills

Azure Databricks

Python Programming

SQL

PySpark

Data Quality Assurance

Job description

A leading healthcare payor is actively seeking to hire a Azure Data Engineer with Databricks experience to help shape the future of data innovation. This is your chance to join a growing Enterprise Data Office where your work will directly impact patient outcomes, operational efficiency, and data-driven decision-making.

Key responsibilities include:

• Design, develop and implement end-to-end data solutions using Azure Databricks.
• Convert legacy SQL workflows into modern Python-based pipelines.
• Maintain and optimize high-volume data pipelines in production.
• Write, test, and tune PySpark and SQL scripts for performance and scalability.
• Ensure data quality and integrity through robust validation and cleansing processes.

PLEASE NOTE: We are looking for someone who values in person collaboration and is willing to come onsite twice a week in Newtown Square, PA 19073.

Compensation:

$58/hr to $65/hr.

Exact compensation may vary based on several factors, including skills, experience, and education.

Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching. Employees in this role are also entitled to paid sick leave and/or other paid time off as provided by applicable law.