Azure Data Engineer: Scalable Pipelines & AI Enablement

Healthworksai; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

Healthworksai in the United States is seeking an experienced Data Engineer to build reliable, scalable data pipelines for CPG clients. The role blends strong technical foundations with analytics value, including Python ETL automation and collaboration with client teams.

You'll develop and maintain ETL/ELT workflows using Azure Data Factory and Databricks, ingest data from APIs and web sources, and enable dashboards via Power BI or Tableau in partnership with analysts.

Qualifications

• 4+ years of experience in Data Engineering or Data Analytics.
• Strong SQL and Python skills, with data manipulation libraries.
• Experience with API-based data ingestion and data transformation.
• Experience with cloud data platforms (Azure) and ETL/ELT workflows.

Responsibilities

• Collaborate with client teams and stakeholders to gather data requirements.
• Design and maintain ETL/ELT pipelines across Azure Data Factory and Databricks.
• Ingest data from external APIs and perform data cleaning and backfill handling.
• Automate reporting workflows to improve efficiency.
• Explore AI-enabled approaches to optimize data processes and analytics.
• Build reusable Python utilities and modules to promote code reuse.
• Partner with analytics to structure raw data for reporting in BI tools.

Skills

Client interface

Data pipeline design

Cloud platforms

Python

SQL

Communication

Adaptability

Education

Graduate/Postgraduate from Tier 1/Tier 2 institutions

Tools

Azure Data Factory

Databricks

Key Vault

Blob/ADLS

Git

Python (pandas, requests, PySpark)

Job description

Healthworksai in the United States is seeking an experienced Data Engineer to build reliable, scalable data pipelines for CPG clients. The role blends strong technical foundations with analytics value, including Python ETL automation and collaboration with client teams.

You'll develop and maintain ETL/ELT workflows using Azure Data Factory and Databricks, ingest data from APIs and web sources, and enable dashboards via Power BI or Tableau in partnership with analysts.