Lead Data Engineer

Conch Technologies Inc; Madison (WI); Hybrid; USD 120,000 - 180,000; Full time

Job summary

Conch Technologies Inc in Madison, WI, is seeking a Lead Data Engineer for a 6+ month hybrid contract to hire. You will lead data pipeline initiatives, partner with product and analytics teams, and drive scalable solutions in a cloud-first environment.

Required: 8–10+ years in data engineering, 3+ years in a lead role, expert Python, strong GCP, BigQuery, Dataflow, Airflow, Pub/Sub, and SQL. Experience with large datasets, ETL/ELT design, and CI/CD is essential.

Qualifications

• Bachelor's Degree in Computer Science, Engineering, Information Systems, or related field.
• 8-10+ years of Data Engineering experience.
• 3+ years in a Lead, Principal, or Senior Data Engineering capacity.
• Expert-level proficiency with Python for data engineering and data processing.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Extensive experience with: BigQuery, Dataflow, Dataproc / PySpark, Cloud Composer (Airflow), Pub/Sub, Cloud Storage.
• Strong SQL development and data modeling experience.
• Experience building enterprise-scale ETL/ELT pipelines.
• Experience working with large-volume datasets and performance optimization.
• Knowledge of CI/CD, Git, DevOps practices, and automated deployment frameworks.
• Strong communication and stakeholder management skills.
• Ability to work independently and lead technical initiatives from concept through production.

Responsibilities

• Lead data engineering initiatives from concept through production (as inferred).

Skills

Leadership

Stakeholder management

Independent work

Communication

Education

Bachelor's degree

Tools

Python

Google Cloud Platform (GCP)

BigQuery

Dataflow

Dataproc / PySpark

Cloud Composer (Airflow)

Pub/Sub

Cloud Storage

SQL

Job description

Hello,

Position: Lead Data Engineer

Location: Madison, WI (Hybrid)

Duration: 6+months

C2H (Contract to Hire)

Job Description

• Bachelor's Degree in Computer Science, Engineering, Information Systems, or related field.
• 8-10+ years of Data Engineering experience.
• 3+ years in a Lead, Principal, or Senior Data Engineering capacity.
• Expert-level proficiency with Python for data engineering and data processing.
• Strong hands-on experience with Google Cloud Platform (GCP).
• Extensive experience with:
  • BigQuery
  • Dataflow
  • Dataproc / PySpark
  • Cloud Composer (Airflow)
  • Pub/Sub
  • Cloud Storage
• Strong SQL development and data modeling experience.
• Experience building enterprise-scale ETL/ELT pipelines.
• Experience working with large-volume datasets and performance optimization.
• Knowledge of CI/CD, Git, DevOps practices, and automated deployment frameworks.
• Strong communication and stakeholder management skills.
• Ability to work independently and lead technical initiatives from concept through production.

Preferred Qualifications

• Experience with Snowflake, Databricks, or modern lakehouse architectures.
• Experience enabling AI/ML workloads and feature engineering pipelines.
• Knowledge of data governance, data quality frameworks, and regulatory compliance requirements.
• Experience working within large enterprise Agile environments.