Lead Data Engineer: Scalable ETL, Data Quality & Architecture

Intelliswift

Madison (WI)

On-site

USD 115,000 - 155,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Intelliswift - An LTTS Company seeks a data engineering lead to drive data solutions across the lifecycle. You will guide architecture, develop scalable ETL, and mentor teams to deliver robust data pipelines.

The role requires deep experience with GCP, Python-based ETL, and modern data stores, with emphasis on data quality, security, and scalable design. Collaboration with stakeholders is essential to success.

Qualifications

  • Customer-driven data solutions experience.
  • Proficient with SQL or NoSQL and diverse data stores.
  • Extensive Python ETL development for data workflows.
  • Experience with big data batch tooling (Hadoop or Spark).
  • Knowledge of ML toolkits (scikit-learn/SparkML/H2O).
  • Strong data modeling principles and database internals understanding.
  • Experience with CI/CD tools and version control (Jenkins, Git).

Responsibilities

  • Leads an engineering team to meet project deadlines and priorities.
  • Ensures data quality, security, privacy, and integrity across data lifecycles.
  • Documents critical workflows and operational support aspects of team responsibilities.
  • Develops deep understanding of data sources, granularity, availability, and limits.
  • Provides proactive technical oversight to data architecture and development teams.
  • Creates maintainable, scalable code to load/manipulate data in the data warehouse.
  • Facilitates communication across project teams and stakeholders.

Skills

GCP
SQL
Python
ETL
Big data
Hadoop
Spark
CI/CD
Data modeling

Tools

Docker
CloudFormation
Terraform

Job description

Intelliswift - An LTTS Company seeks a data engineering lead to drive data solutions across the lifecycle. You will guide architecture, develop scalable ETL, and mentor teams to deliver robust data pipelines.

The role requires deep experience with GCP, Python-based ETL, and modern data stores, with emphasis on data quality, security, and scalable design. Collaboration with stakeholders is essential to success.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Engineer
Lead Data Engineer

TechDigital Group • Warsaw (IN)

On-site
USD 80,000 - 120,000
Lead Data Engineer
Lead Data Engineer

Good co India • United States

Remote
USD 120,000 - 180,000
Senior Data Engineer
Senior Data Engineer

Gennte Technologies • Pittsburgh

Hybrid
USD 100,000 - 140,000
Lead Data Engineer
Lead Data Engineer

Harnham • United States

On-site
USD 150,000 - 210,000
Lead Data Engineer — Scalable Pipelines & Data Quality
Lead Data Engineer — Scalable Pipelines & Data Quality

Attic Projects • Irving (TX)

On-site
USD 145,000 - 180,000
Health insurance
Dental insurance
Vision coverage
+9
Senior Data Engineer: Lead Scalable ETL & AI Pipelines
Senior Data Engineer: Lead Scalable ETL & AI Pipelines

Iscale Solutions • United States

Remote
USD 120,000 - 180,000
Salary package
Vacation and sick leave
Health coverage
+6
Lead Data Engineer: Snowflake & AWS Champion
Lead Data Engineer: Snowflake & AWS Champion

Empower • United States

Hybrid
USD 125,000 - 182,000
Medical insurance
401(k) plan
Tuition reimbursement
+2
Lead Data Engineer: Scalable Data & AI Platform
Lead Data Engineer: Scalable Data & AI Platform

LAM Lennar Associates Mgmt LLC • Florida

On-site
USD 122,000 - 152,000
Health insurance
401(k) with match
Paid parental leave
+2
Lead Data Engineer: Scalable Pipelines & Architecture
Lead Data Engineer: Scalable Pipelines & Architecture

Talent Software Services, Inc. • Charleston (SC)

On-site
USD 120,000 - 180,000
Senior Data Engineer: Build Scalable ETL Pipelines on GCP
Senior Data Engineer: Build Scalable ETL Pipelines on GCP

Tata Consultancy Services Limited • Sunnyvale (CA)

On-site
USD 110,000 - 150,000
Discretionary Annual Incentive
Comprehensive Medical Coverage: Health
Dental & Vision
+6