Senior Data Engineer-Microsoft Fabric

Boston Insights

United States

Remote

USD 130,000 - 170,000

Full time

4 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Boston Insights is seeking a Senior Data Engineer to design and maintain scalable data platforms across clinical supply chain operations. The role focuses on Python, SQL, Databricks, PySpark, ETL/ELT pipelines, and data modeling to enable analytics and AI-driven solutions.

You will work with MSSQL, Azure PostgreSQL, REST APIs, and modern cloud services in a collaborative, data-driven environment. Experience with Power BI/Tableau is a plus.

Qualifications

  • 7-10 years of experience in data engineering or related roles.

Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines using Python, SQL, Databricks, and PySpark.
  • Build reliable data ingestion and transformation workflows across multiple enterprise data sources.
  • Develop and optimize data models to support analytics, reporting, and intelligent applications.
  • Ensure data quality, consistency, reliability, and performance across data platforms.
  • Work with MSSQL and Azure Database for PostgreSQL.
  • Develop and integrate REST APIs to connect data platforms and enterprise applications.
  • Build and maintain scalable data architectures using Azure and Fabric services.
  • Support AI/ML integration and real-time data processing where required.
  • Collaborate on analytics and visualization solutions using Power BI or Tableau.

Skills

Python
SQL
Databricks
PySpark
Data modeling
ETL/ELT
AI/ML data solutions
REST APIs
Power BI
Tableau
Microsoft Fabric

Tools

Databricks
Azure
REST API development
Power BI
Tableau
Git

Job description

Senior Data Engineer

Boston Insights is looking for an experienced Senior Data Engineer with 510 years of experience to design, develop, and maintain scalable data platforms supporting AXIOM, our next-generation clinical supply chain control tower. The ideal candidate will have strong expertise in Python, SQL, Databricks, PySpark, ETL/ELT pipelines, data modeling, and modern cloud data technologies. Experience with Microsoft Fabric, Azure, REST API integrations, and AI-driven data solutions will be an added advantage.

Key Responsibilities
Data Engineering & Pipeline Development
  • Design, develop, database schemas, build and maintain scalable ETL/ELT pipelines using Python, SQL, Databricks, and PySpark.
  • Build reliable data ingestion and transformation workflows across multiple enterprise data sources.
  • Develop and optimize data models to support analytics, reporting, and intelligent applications.
  • Ensure data quality, consistency, reliability, and performance across data platforms.
Database & API Integration
  • Work with Microsoft SQL Server (MSSQL) and Azure Database for PostgreSQL.
  • Develop and integrate REST APIs to connect data platforms and enterprise applications.
  • Design efficient database structures, queries, and data processing workflows.
  • Support secure and scalable data exchange between systems.
Cloud Data Platforms & Modern Architecture
  • Work with Microsoft Azure and modern cloud-based data engineering services.
  • Contribute to Microsoft Fabric implementations, including OneLake, Lakehouse, Data Factory, and Fabric Warehouse.
  • Build and maintain scalable and reusable data architecture.
  • Collaborate with engineering teams to improve deployment and integration workflows.
AI, Automation & Analytics
  • Support AI/ML integration and intelligent data processing capabilities.
  • Contribute to real-time data processing and event-driven architectures where required.
  • Collaborate on analytics and visualization solutions using Power BI, Tableau, or similar tools.
  • Explore opportunities to improve data workflows through automation and AI capabilities.
Required Technical Skills & Experience
  • 7- 10 years of experience in data engineering or related engineering roles.
  • Strong programming experience in Python and SQL.
  • Hands-on experience with Databricks and PySpark.
  • Experience with Microsoft SQL Server (MSSQL).
  • Experience with Azure Database for PostgreSQL.
  • Strong understanding of ETL/ELT pipelines and data modeling.
  • Experience developing and integrating REST APIs.
Preferred Skills & Experience
  • Knowledge of Microsoft Fabric, including OneLake, Lakehouse, Data Factory, and Fabric Warehouse.
  • Familiarity with the Microsoft Azure ecosystem.
  • Experience with Azure DevOps, Git, and CI/CD pipelines.
  • Exposure to Azure Data Factory, Azure Functions, and Azure cloud services.
  • Basic knowledge of React, HTML, and CSS.
  • Experience with Power BI, Tableau, or other data visualization tools.
  • Exposure to AI/ML integration, real-time data processing, or Apache Kafka.
Domain Preference

Experience in any of the following domains will be preferred:

  • Clinical Supply Chain
  • Healthcare & Pharmaceutical Supply Chain
  • Inventory & Warehouse Management
  • Procurement, Logistics & Distribution
  • Enterprise Supply Chain Platforms
The Opportunity We Offer
  • Product Innovation: Build a next-generation AI-powered clinical supply chain platform.
  • Modern Technology: Work with Databricks, PySpark, Microsoft Fabric, Azure, and advanced data technologies.
  • Real-World Impact: Solve complex data engineering challenges across pharmaceutical and healthcare supply chains.
  • AI & Automation: Contribute to intelligent automation, advanced analytics, and AI-driven capabilities.
  • Growth: Collaborate with a product engineering team focused on innovation and scalable technology.
Join Boston Insights

If you're passionate about data engineering, modern data platforms, and building intelligent technology solutions, we'd love to hear from you.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Precision Technologies • New Jersey

On-site
USD 120,000 - 180,000
Senior Data Engineer — AI-Powered Data Platform & Pipelines
Senior Data Engineer — AI-Powered Data Platform & Pipelines

Boston Insights • United States

Remote
USD 130,000 - 170,000
Data Engineer
Data Engineer

betterdebtsolutions • Irvine (CA)

On-site
USD 140,000 - 155,000
Data, Analytics & AI Engineer
Data, Analytics & AI Engineer

Deploy Alloy • Birmingham (AL)

On-site
USD 110,000 - 150,000
Senior Data Engineer
Senior Data Engineer

Foundation Partners Group • Orlando (FL)

On-site
USD 120,000 - 160,000
Senior Data Engineer
Senior Data Engineer

Foundation Partners Group • Orlando (FL)

On-site
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

RBA, Inc. • United States

On-site
USD 120,000 - 190,000
Platform Data Engineer
Platform Data Engineer

360insights • United States

Remote
USD 110,000 - 170,000
Data Engineer
Data Engineer

Fracht Group - North America • Houston (TX)

On-site
USD 140,000 - 190,000
Data Engineer
Data Engineer

Franklin Fitch • United States

Remote
USD 140,000 - 160,000