Lead Data Engineer: Scalable ETL, Data Quality & Architecture

Intelliswift - An LTTS Company; Madison (WI); On-site; USD 115,000 - 155,000; Full time

Job summary

Intelliswift - An LTTS Company seeks a data engineering lead to drive data solutions across the lifecycle. You will guide architecture, develop scalable ETL, and mentor teams to deliver robust data pipelines.

The role requires deep experience with GCP, Python-based ETL, and modern data stores, with emphasis on data quality, security, and scalable design. Collaboration with stakeholders is essential to success.

Qualifications

• Customer-driven data solutions experience.
• Proficient with SQL or NoSQL and diverse data stores.
• Extensive Python ETL development for data workflows.
• Experience with big data batch tooling (Hadoop or Spark).
• Knowledge of ML toolkits (scikit-learn/SparkML/H2O).
• Strong data modeling principles and database internals understanding.
• Experience with CI/CD tools and version control (Jenkins, Git).

Responsibilities

• Leads an engineering team to meet project deadlines and priorities.
• Ensures data quality, security, privacy, and integrity across data lifecycles.
• Documents critical workflows and operational support aspects of team responsibilities.
• Develops deep understanding of data sources, granularity, availability, and limits.
• Provides proactive technical oversight to data architecture and development teams.
• Creates maintainable, scalable code to load/manipulate data in the data warehouse.
• Facilitates communication across project teams and stakeholders.

Skills

GCP

SQL

Python

ETL

Big data

Hadoop

Spark

CI/CD

Data modeling

Tools

Docker

CloudFormation

Terraform

Job description

Intelliswift - An LTTS Company seeks a data engineering lead to drive data solutions across the lifecycle. You will guide architecture, develop scalable ETL, and mentor teams to deliver robust data pipelines.

The role requires deep experience with GCP, Python-based ETL, and modern data stores, with emphasis on data quality, security, and scalable design. Collaboration with stakeholders is essential to success.