Data Engineer with ETL/ELT pipelines and API integrations

DHANU GLOBAL ENTERPRISES, INC.

Indianapolis (IN)

Vor Ort

USD 100.000 - 150.000

Teilzeit

14 Tage+

Erhalte eine Antwort von diesem Arbeitgeber

Dein Lebenslauf und dein Anschreiben, genau auf das zugeschnitten, was gesucht wird.

Schaffe es an den ATS-Filtern vorbei

Zusammenfassung

Oorwin AI in Indianapolis, IN is hiring a Data Engineer with ETL/ELT pipelines and API integrations on a contractual basis. The role focuses on building data pipelines, API integrations, and AI infrastructure for a governed, Azure-based platform that ingests structured and unstructured data from multiple sources.

The engineer will implement data quality, lineage, and audit trails to support regulatory reporting, analytics, and AI-driven insights in a compliant environment.

Qualifikationen

  • 8+ years of hands-on Data Engineering experience delivering production ETL/ELT pipelines and API integrations.
  • Expert-level Python and/or PySpark for data ingestion, transformation, orchestration, testing, and CI/CD.
  • Experience with Microsoft Azure Fabric (Lakehouse, Data Factory, Fabric Pipelines, Delta Lake) delivering end-to-end production solutions.
  • Hands-on AWS experience, including S3, Glue (or equivalent), and RDS/Aurora.
  • Strong SQL and PostgreSQL experience, including normalized schema design, query optimization, indexing, and performance tuning.
  • Experience with data modeling, medallion architecture, and Lakehouse design patterns.
  • Experience implementing data lineage, quality controls, schema validation, error handling, and monitoring in regulated environments.
  • Knowledge of GxP, GMP, GCP within pharmaceutical, biotechnology, or medical device environments
  • SCM, WMS, PLM, MM, QA, any validated applications within FDA Regulated systems

Aufgaben

  • Design, build, and maintain production ETL/ELT pipelines integrating laboratory and operational systems into Azure Fabric Lakehouse and PostgreSQL.
  • Develop and optimize bronze/silver/gold medallion architecture with schema mapping and data modeling.
  • Build scalable API integrations and cross-cloud data pipelines across Azure and AWS.
  • Implement automated data quality controls, normalization, schema validation, data lineage, and audit trails for compliance.
  • Monitor, troubleshoot, and optimize pipeline performance and reliability in production.
  • Collaborate with business, engineering, and IT to create a governed digital thread for analytics and regulatory reporting.

Kenntnisse

Python/PySpark
ETL/ELT pipelines
API integrations
SQL/PostgreSQL
Azure Fabric
Azure Data Factory
AWS S3/Glue
Data modeling
Data lineage/QA
GxP/GMP

Tools

Azure Fabric Lakehouse
Azure services
PostgreSQL tuning

Jobbeschreibung

Data Engineer with ETL/ELT pipelines and API integrations

Job Id : OOJ - 2097

Posted Date : 09/27/2026

Experience : 8-15

Job Type : Contractual

Location : Indianapolis, IN

Overview

Position Title:Data Engineer with ETL/ELT pipelines and API integrationsLocation:Indianapolis,IN(onsite 5 days per week)Duration: Through December 2026, possible extension into 2027Job DescriptionPharmaceutical’s client is building a governed data and AI platform, integrating device, laboratory, partner, and document data into a unified foundation that supportsregulatoryreporting, advanced analytics, and AI-driven scientificinsights.The Data Engineer is a hands-on builder responsible for developing data pipelines, API integrations, and AI infrastructure that bring structured and unstructured data into a governedAzure-basedarchitecture. This delivery-focused rolerequires designing, coding, testing, and maintaining production-ready solutions across both AI document ingestion and structured ETL/ELT data engineering tracks. This role integrates structured and unstructureddata fromlaboratory systems, product lifecycleapplications, and manufacturing partners into a governed Azure-based data platform, creating a scalable, audit-ready digital thread that supports analytics, AI, and regulatory compliance.

Key Responsibilities
  • Design, build, and maintain production ETL/ELT pipelines integrating laboratory and operational systems (e.g., Darwin, Teamcenter/PLM, LabVantage LIMS, Jama, TurboAC, and Qdocs/Veeva) into Microsoft AzureFabric Lakehouse and PostgreSQL.
  • Develop and optimize Bronze, Silver, and Gold medallion architecture, including schema mapping, data modeling, referential integrity, and performance optimization.
  • Build scalable API integrations and cross-cloud data pipelines across Azure and AWS to support enterprise data integration.
  • Implement automated data quality controls, controlled vocabulary normalization, schema validation, Q-gate/specification checks, data lineage, and audit trails to ensure GxP compliance.
  • Monitor, troubleshoot, and optimize pipeline performance, reliability, error handling, and operational monitoring in production environments.
  • Collaborate with business, engineering, and IT teams to integrate data sources and establish a governed, scalable digital thread supporting analytics, AI, and regulatory reporting.
Required Skills
  • 8+ years of hands-on Data Engineering experience building production ETL/ELT pipelines and API integrations.
  • Expert-level Python and/or PySpark for data ingestion, transformation, orchestration, testing, and CI/CD.
  • Experience with Microsoft Azure Fabric (Lakehouse, Data Factory, Fabric Pipelines, Delta Lake) delivering end-to-end production solutions.
  • Hands-on AWS experience, including S3, Glue (or equivalent), and RDS/Aurora.
  • Strong SQL and PostgreSQL experience, including normalized schema design, query optimization, indexing, and performance tuning.
  • Experience with data modeling, medallion architecture, and Lakehouse design patterns.
  • Experience implementing data lineage, quality controls, schema validation, error handling, and monitoring in regulated environments.
  • Knowledge of GxP, GMP, GCP within pharmaceutical, biotechnology, or medical device environments
  • SCM, WMS, PLM, MM, QA, any validated applications with in a FDA Regulated systems
Skills

Data Engineer with ETL/ELT pipelines and API integrations,TuboAC,Microsoft Azure Fabric

Hol dir deinen kostenlosen, vertraulichen Lebenslauf-Check.

oder ziehe deine Datei hierhin.

Similar jobs

Ähnliche Jobs, die dir auch gefallen könnten

Data Engineer
Data Engineer

Compunnel Inc. • Norfolk (VA)

Vor Ort
USD 110.000 - 150.000
Data Integration Engineer
Data Integration Engineer

Red Arch Solutions • Reston (VA)

Vor Ort
USD 160.000 - 185.000
Data Engineer Lead
Data Engineer Lead

VSE AVIATION INC (US) • Phoenix (AZ)

Vor Ort
USD 140.000 - 200.000
Data Engineer
Data Engineer

TG Administration LLC • Scottsdale (AZ)

Vor Ort
USD 95.000 - 130.000
Healthcare Benefits
Retirement Benefits
Time Off
ETL Developer / Data Integration
ETL Developer / Data Integration

Compunnel Inc. • Aliso Viejo (CA)

Hybrid
USD 100.000 - 150.000
Senior Data Engineer
Senior Data Engineer

Xenon Seven • Cincinnati (OH)

Hybrid
USD 130.000 - 190.000
ETL Data Platform Developer
ETL Data Platform Developer

Valiant Technologies LLC • Redmond (WA)

Vor Ort
USD 140.000 - 190.000
Senior Data Engineer
Senior Data Engineer

Compunnel Inc. • Charlotte (NC)

Vor Ort
USD 120.000 - 150.000
Azure Data Engineer
Azure Data Engineer

Recru • Fort Worth (TX), Arlington (TX), Dallas (TX)

Vor Ort
USD 120.000 - 150.000
Senior Data Engineer
Senior Data Engineer

Xenon Seven • Indianapolis (IN)

Hybrid
USD 150.000 - 210.000