ETL Team Lead - Real-Time Azure Data Pipelines

The Jacobson Group

United States

Hybrid

USD 120,000 - 135,000

Full time

14 days+

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Medical insurance
Dental insurance
Vision insurance
401(k) retirement savings plan

Job summary

The Jacobson Group is seeking an ETL Team Lead to provide technical leadership for data operations, production support and modernization in a hybrid role within the United States.

You will oversee the reliability of existing data pipelines, advance a modern Azure data ecosystem using Delta Lake, Medallion Architecture and Fabric Lakehouse technologies, and guide onshore/offshore developers while mentoring junior engineers.

Qualifications

  • ETL team leadership experience.
  • Microsoft SQL Server database programming.
  • T-SQL scripting.
  • SQL Server Integration Services.
  • Microsoft PowerShell.
  • Guidewire DataHub and InfoCenter.
  • Oracle database programming and PL-SQL scripting.
  • SAP BODS and PostgreSQL scripting.
  • Azure data technologies and modern data architecture.
  • Real-time data pipelines and streaming analytics.
  • Data modeling, curation and governance.
  • Experience guiding developers and collaborating with cross-functional teams.

Responsibilities

  • Monitor daily ETL loads across SQL jobs, Guidewire DataHub and InfoCenter environments and legacy SSIS packages.
  • Troubleshoot pipeline failures, performance issues, schema mismatches, permissions issues and cloud resource failures with the AMS team.
  • Perform root-cause analysis and implement permanent fixes while ensuring SLA adherence and on-time delivery of critical reporting datasets.
  • Maintain and improve pipelines using Microsoft SQL Server, T-SQL, SQL Server Integration Services, Microsoft PowerShell, Oracle, SAP BODS and PostgreSQL.
  • Create or enhance operational runbooks, standard operating procedures, monitoring dashboards and incident response workflows.
  • Coordinate production releases, validate deployments and support month-end and quarter-end financial reporting cycles.
  • Guide onshore and offshore developers, review code, enforce best practices and mentor junior engineers.
  • Develop reusable ingestion patterns and scalable pipelines for Guidewire DataHub and InfoCenter, HubSpot, Telematics and other business data.
  • Modernize ETL workloads using Delta Lake, Medallion Architecture, Fabric Lakehouse, Azure Data Factory, Microsoft Fabric, Databricks and Synapse Pipelines.
  • Design and implement real-time data pipelines using Event Hub, Fabric Real-Time Analytics, Databricks Structured Streaming and KQL-based event processing.
  • Develop curated datasets for Power BI, operational reporting and advanced analytics while establishing data quality, validation, alerting and observability frameworks.

Skills

ETL team leadership
SQL Server & T-SQL
SSIS
PowerShell
Guidewire DataHub & InfoCenter
Oracle PL-SQL
SAP BODS
PostgreSQL
Azure data technologies
Delta Lake & Medallion Architecture
Real-time data pipelines
Data modeling & governance
Mentoring developers

Tools

SQL Server
SSIS
Azure Data Factory
Databricks
Synapse
KQL
PowerShell
Guidewire DataHub
InfoCenter
Oracle
SAP BODS
PostgreSQL

Job description

The Jacobson Group is seeking an ETL Team Lead to provide technical leadership for data operations, production support and modernization in a hybrid role within the United States.

You will oversee the reliability of existing data pipelines, advance a modern Azure data ecosystem using Delta Lake, Medallion Architecture and Fabric Lakehouse technologies, and guide onshore/offshore developers while mentoring junior engineers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

ETL Team Lead
ETL Team Lead

The Jacobson Group • United States

Hybrid
USD 120,000 - 135,000
Medical insurance
Dental insurance
Vision insurance
+1
ETL Tech Lead — Data Platform & Real-Time Ops
ETL Tech Lead — Data Platform & Real-Time Ops

Canal Insurance Company • Greenville (SC)

On-site
USD 110,000 - 160,000
Basic & Voluntary Life Insurance Plans
Short Term & Long Term Disability
401(k) plan with company match up to 6
+3
Azure Data Engineering Lead - Pipelines, Databricks & Data Lake
Azure Data Engineering Lead - Pipelines, Databricks & Data Lake

Tata Consultancy Services Limited • Stamford (CT)

On-site
USD 110,000 - 130,000
Discretionary Annual Incentive
Medical Coverage
Family Support
+2
Senior Azure Databricks Data Engineer: Delta Lake Pipelines
Senior Azure Databricks Data Engineer: Delta Lake Pipelines

EXL • Detroit (MI)

On-site
USD 120,000 - 190,000
Azure Data Engineer: Build Scalable ELT Pipelines
Azure Data Engineer: Build Scalable ELT Pipelines

Ethereum Technologies • Austin (TX)

On-site
USD 90,000 - 130,000
ETL Lead - Data Modernization & Cloud Migration
ETL Lead - Data Modernization & Cloud Migration

TechDigital Group • Secaucus (NJ)

On-site
USD 120,000 - 180,000
EDI Migration Lead: Azure DevOps & Stakeholder Liaison
EDI Migration Lead: Azure DevOps & Stakeholder Liaison

TechDigital Group • Greensboro (NC)

On-site
USD 80,000 - 110,000
Senior Data Engineer — Azure Fabric, Delta Lake & Pipelines
Senior Data Engineer — Azure Fabric, Delta Lake & Pipelines

Datavail Infotech • United States

On-site
USD 130,000 - 170,000
Senior ETL Developer | Lead Data Pipelines & Real-Time
Senior ETL Developer | Lead Data Pipelines & Real-Time

Ampcus Inc • Orlando (FL)

On-site
USD 110,000 - 140,000
Azure Data Engineer
Azure Data Engineer

Recru • Fort Worth (TX), Arlington (TX), Dallas (TX)

On-site
USD 120,000 - 150,000