Data Engineering Tech Lead: Architect Real-Time Pipelines

Quicklizard

United States

On-site

USD 140,000 - 200,000

Full time

11 days ago
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

Quicklizard is seeking a Data Engineering Tech Lead to own end-to-end data architecture, design scalable pipelines, and mentor a team of data engineers while contributing code. The role spans ingestion, data lake, analytics, and API data exposure across AWS and GCP.

You will set technical direction and drive architectural decisions to support pricing decisions at scale. The ideal candidate brings 5+ years in data engineering, deep SQL, Python/Go, and hands-on experience with cloud data

Qualifications

  • Minimum 5 years of production data engineering experience.
  • Deep SQL expertise and distributed processing with Spark or equivalent.
  • Proficient in Python and/or Go.
  • Hands-on experience with cloud data warehouses (BigQuery, Snowflake, Redshift) and orchestration tooling.
  • Experience with AI tools/LLM-driven data products is a plus.
  • Proven technical leadership, mentoring, and architecture ownership.

Responsibilities

  • Architect and build large-scale batch and streaming ETL/ELT pipelines.
  • Own data lake design, table modeling, and partitioning strategy across billion-row datasets.
  • Drive query performance and cloud cost optimization across AWS and GCP.
  • Establish data quality, observability, and reliability standards (freshness, correctness, SLAs).
  • Partner with backend, product, and data science teams to expose data via APIs.
  • Lead technically: review designs and code, mentor engineers, raise the bar for the data org.

Skills

Deep SQL
Distributed processing
Python
Go
Cloud data warehouses
BigQuery
Snowflake
Redshift
Spark
Airflow
PostgreSQL/Aurora
Kubernetes
Terraform

Tools

Spark
Airflow
BigQuery
Snowflake
Redshift
PostgreSQL/Aurora
Kafka
RabbitMQ
Elasticsearch
AWS
GCP
Kubernetes
Terraform

Job description

Quicklizard is seeking a Data Engineering Tech Lead to own end-to-end data architecture, design scalable pipelines, and mentor a team of data engineers while contributing code. The role spans ingestion, data lake, analytics, and API data exposure across AWS and GCP.

You will set technical direction and drive architectural decisions to support pricing decisions at scale. The ideal candidate brings 5+ years in data engineering, deep SQL, Python/Go, and hands-on experience with cloud data

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Data Engineer Tech Lead
Data Engineer Tech Lead

Quicklizard • United States

On-site
USD 140,000 - 200,000
Lead Data Engineer – Real-Time Pipelines & Leadership
Lead Data Engineer – Real-Time Pipelines & Leadership

Talanto • Northern (KY)

Hybrid
USD 125,000 - 182,000
Medical, dental, vision and life
401(k) with company match
Tuition reimbursement
+3
Lead Data Engineer: Real-Time Pipelines & Cloud Data
Lead Data Engineer: Real-Time Pipelines & Cloud Data

Tiger Analytics Inc. • Richmond (VA)

On-site
USD 140,000 - 200,000
Lead Data Engineer — Real-Time Pipelines & Streaming
Lead Data Engineer — Real-Time Pipelines & Streaming

Empower • Greenwood Village (CO)

Hybrid
USD 125,000 - 182,000
Medical Insurance
Dental Insurance
Vision Insurance
+5
Senior Data Engineer: Lead Lakehouse Pipelines & ETL
Senior Data Engineer: Lead Lakehouse Pipelines & ETL

Dynata • United States

On-site
USD 130,000 - 150,000
Medical benefits
Discretionary incentive program
Lead Data Engineer — AI‑Driven Data Pipelines (Remote)
Lead Data Engineer — AI‑Driven Data Pipelines (Remote)

Quantiphi • United States

On-site
USD 140,000 - 190,000
Senior Data Engineer — Cloud Pipelines & API Integration
Senior Data Engineer — Cloud Pipelines & API Integration

Description GovDeals • United States

Remote
USD 135,000 - 153,000
Competitive wages
401(k) plan
Paid time off (PTO) and holidays
+5
Senior Data Engineer: Real-Time Pipelines on AWS
Senior Data Engineer: Real-Time Pipelines on AWS

eOne Infotech • Fort Mill (SC)

On-site
USD 90,000 - 120,000
Senior Data Engineer: Scale Pipelines & Lakehouse Leadership
Senior Data Engineer: Scale Pipelines & Lakehouse Leadership

Survey Sampling International Hyderabad Private Ltd. (India) • Westport (CT)

On-site
USD 130,000 - 150,000
Medical benefits
Discretionary incentive program
Senior Data Engineer - Remote Cloud Data Pipelines & APIs
Senior Data Engineer - Remote Cloud Data Pipelines & APIs

Liquidity Services, Inc. • United States

On-site
USD 136,000 - 153,000
401(k) plan
Paid time off (PTO) and holidays
Paid parental leave
+3