Data Engineer & Production Lead (GCP, BigQuery)

Insight Global; Hartford (CT); On-site; USD 80,000 - 90,000; Full time

Benefits offered by this job

Medical, dental, vision insurance

HSA, FSA, DCFSA accounts

401k with employer matching

Paid sick leave / PTO

Job summary

Insight Global is seeking an experienced Data Engineer/Data Warehouse Production Support Lead to head the development, maintenance, and production support of enterprise data solutions across large-scale warehouses, data marts, and pipelines.

The role requires hands-on leadership while building and optimizing ETL workflows with Ab Initio, SQL, Unix/Linux, and Python, and guiding modernization of workloads to Google Cloud Platform and BigQuery.

Qualifications

• 5+ years in ETL design, data warehousing, and production support.
• 5+ years with Ab Initio (GDE, EME, graphs, plans).
• 5+ years advanced SQL in enterprise.
• 5+ years Unix/Linux and shell scripting.
• 3+ years with programming languages, development tools, databases, and the SDLC.
• 2+ years with GCP, BigQuery, and Python.

Responsibilities

• Lead development, maintenance, and production support of enterprise data solutions across large-scale data warehouses, data marts, repositories, and data pipelines.
• Design, develop, test, troubleshoot, and optimize complex ETL workflows using Ab Initio, SQL, Unix/Linux, and Python.
• Develop and support Ab Initio graphs, plans, scripts, reusable components, parameter sets, and EME assets.
• Resolve production incidents, ETL failures, data-quality issues, batch-processing problems, and performance concerns.
• Support modernization and migration of Ab Initio and DB2 workloads to GCP and BigQuery, collaborating with cross-functional teams.

Skills

Ab Initio

SQL

Unix/Linux

Shell scripting

Python

CI/CD

GitHub/DevOps practices

Communication

Leadership

Tools

GCP

BigQuery

DB2

Ab Initio graphs/ETL components

ETL development

Job description

Insight Global is seeking an experienced Data Engineer/Data Warehouse Production Support Lead to head the development, maintenance, and production support of enterprise data solutions across large-scale warehouses, data marts, and pipelines.

The role requires hands-on leadership while building and optimizing ETL workflows with Ab Initio, SQL, Unix/Linux, and Python, and guiding modernization of workloads to Google Cloud Platform and BigQuery.