Data Engineering Manager — Lead Pipelines & Lakehouse

Ring Inc; Alpharetta (GA); Hybrid; USD 150,000 - 230,000; Full time

Benefits offered by this job

Competitive salary

Hybrid work arrangements

Continuous learning & leadership dev

Job summary

PDI Technologies seeks an experienced data engineering leader to own data ingestion, the lakehouse, and the query layer underpinning analytics and product. You will drive architecture across ingestion, lakehouse, and SLOs, while growing a 10+ person data engineering team and actively coding in reviews.

You will set direction for a unified ingestion framework, production Spark pipelines, Iceberg lifecycle, dbt modeling, and Trino catalog design, ensuring low latency and cost efficiency.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
• 8+ years in data engineering, including 3+ years leading engineers as a manager or tech lead.
• Production experience with Spark Structured Streaming at scale.
• Deep Apache Spark and PySpark performance work.
• Experience building or owning a reusable ingestion framework.
• Production experience with an open table format (Iceberg).
• Experience with dbt as a modeling standard.
• Experience with Trino or Presto operations and query optimization.
• Experience running reliable, high-scale platform systems.

Responsibilities

• Lead, hire, and grow a team of 10+ data engineers and set technical bar.
• Own the unified ingestion framework for batch, CDC, and streaming sources.
• Own production Spark Structured Streaming pipelines with checkpointing and exactly-once sinks.
• Own the Apache Iceberg lakehouse including governance and evolution.
• Set the dbt modeling standard and CI enforcement.
• Own Trino catalog design, workload isolation, and query performance.
• Define and meet freshness, completeness, and latency SLOs; run on-call rotation.
• Own cost per pipeline and per dataset; optimize spend.
• Collaborate with product, analytics, and architecture to sequence the roadmap.

Skills

Leadership & people management

Hands-on coding

Data engineering

Cloud & DevOps

Education

Bachelor's degree in CS/Engineering

Tools

Spark Structured Streaming

Apache Iceberg

dbt

Trino/Presto

Kubernetes

Terraform

Kafka

Job description

PDI Technologies seeks an experienced data engineering leader to own data ingestion, the lakehouse, and the query layer underpinning analytics and product. You will drive architecture across ingestion, lakehouse, and SLOs, while growing a 10+ person data engineering team and actively coding in reviews.

You will set direction for a unified ingestion framework, production Spark pipelines, Iceberg lifecycle, dbt modeling, and Trino catalog design, ensuring low latency and cost efficiency.