Data Engineer with ETL/ELT pipelines and API integrations

DataJobs

Indianapolis (IN)

On-site

USD 67,000 - 78,000

Full time

7 days ago

Be an early applicant

Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Dhanu Global Enterprises, Inc. is building a governed data and AI platform in Indianapolis to support regulatory reporting, analytics, and AI insights.

The role is onsite in Indianapolis, focusing on production data engineering, ETL/ELT pipelines, and API integrations within Azure-based architecture. In a GxP/FDA-regulated environment, you will ensure data quality, lineage, and controls while connecting lab, device, and partner data.

Qualifications

8+ years of hands‑on Data Engineering experience building production ETL/ELT pipelines and API integrations.

Responsibilities

Design, build, and maintain production ETL/ELT pipelines that integrate diverse systems into Microsoft Azure Fabric Lakehouse and PostgreSQL.
Develop and optimize a Bronze, Silver, Gold medallion architecture with robust data models and referential integrity.
Build scalable API integrations and cross‑cloud pipelines across Azure and AWS for enterprise data integration.
Implement automated data quality controls, schema validation, data lineage, and audit trails to support GxP compliance.
Monitor, troubleshoot, and optimize pipeline performance and reliability in production environments.
Collaborate with business, engineering, and IT teams to enable analytics, AI, and regulatory reporting.

Skills

Python

PySpark

SQL

PostgreSQL

API integrations

CI/CD

Azure Fabric

AWS

Data modeling

GxP

Tools

Azure Fabric: Lakehouse

Delta Lake

Glue

RDS/Aurora

PostgreSQL

LabVantage LIMS

Jama

Job description

Dhanu Global Enterprises, Inc. is building a governed data and AI platform for a pharmaceutical client, with a focus on connecting device, laboratory, partner, and document information into a unified foundation. In this onsite role in Indianapolis, you will design and deliver production-ready data engineering capabilities that support regulatory reporting, advanced analytics, and AI-driven scientific insights.

Working in a GxP/FDA-regulated environment, you will help integrate structured and unstructured data through an Azure-based architecture, combining governed ETL/ELT pipelines with API integrations and strong operational controls.

What you will do

Design, build, and maintain production ETL/ELT pipelines that integrate laboratory and operational systems (including Darwin, Teamcenter/PLM, LabVantage LIMS, Jama, TurboAC, and Qdocs/Veeva) into Microsoft Azure Fabric Lakehouse and PostgreSQL.
Develop and optimize a Bronze, Silver, Gold medallion architecture, covering schema mapping, data modeling, referential integrity, and performance optimization.
Build scalable API integrations and cross-cloud data pipelines across Azure and AWS to support enterprise data integration.
Implement automated data quality controls, controlled vocabulary normalization, schema validation, Q-gate/specification checks, data lineage, and audit trails to support GxP compliance.
Monitor, troubleshoot, and optimize pipeline performance, reliability, error handling, and operational monitoring for production environments.
Collaborate with business, engineering, and IT teams to connect data sources and establish a governed, scalable digital thread for analytics, AI, and regulatory reporting.

Key requirements

8+ years of hands‑on Data Engineering experience building production ETL/ELT pipelines and API integrations.
Expert-level Python and/or PySpark for ingestion, transformation, orchestration, testing, and CI/CD.
Hands‑on experience with Microsoft Azure Fabric (Lakehouse, Data Factory, Fabric Pipelines, and Delta Lake) delivering end‑to‑end production solutions.
Hands‑on AWS experience, including S3, Glue (or equivalent), and RDS/Aurora.
Strong SQL and PostgreSQL skills, including normalized schema design, query optimization, indexing, and performance tuning.
Experience with data modeling, medallion architecture, and Lakehouse design patterns.
Experience implementing data lineage, quality controls, schema validation, error handling, and monitoring in regulated environments.
Knowledge of GxP, GMP, GCP in pharmaceutical, biotechnology, or medical device environments.
Experience with SCM, WMS, PLM, MM, QA, and/or validated applications in FDA-regulated systems.