Senior Data Ingestion Engineer - Lakehouse & Streaming

Slack

San Francisco (CA)

On-site

USD 173,000 - 286,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Slack is seeking a senior software engineer to join the Data Ingestion Team. You will build scalable streaming and batch pipelines to ingest data from diverse sources into our Lakehouse, handling massive storage and thousands of data pipelines.

You will lead technical initiatives, mentor others, and collaborate with cross-functional partners to deliver high-quality data infrastructure. You will work with technologies like Kafka, Flink, Spark Streaming, Iceberg, Airflow, and Kubernetes to enable

Qualifications

  • 7+ years of software/data engineering experience.
  • Experience with Streaming and Lakehouse technologies (e.g., Kafka, Flink, Spark Streaming, Iceberg/Hudi/Delta).
  • Experience building batch data pipelines using Spark, Airflow, EMR, S3.

Responsibilities

  • Design and develop highly scalable streaming and batch pipelines for ingesting and processing datasets.
  • Design and implement Lakehouse solutions and enable production use cases for customers.
  • Improve reliability and performance of services/pipelines with AI-assisted solutions.
  • Automate dataset lifecycle: schema evolution, metadata management, backfill, migration.
  • Lead technical initiatives end-to-end and collaborate with cross-functional teams.
  • Mentor engineers across the team and provide design feedback.

Skills

Streaming data engineering
Lakehouse architectures
Programming language proficiency

Tools

Kafka
Kafka Connect
Flink
Spark Streaming
Iceberg
Hudi
Delta Lake
Airflow
EMR
S3
Kubernetes
Docker
AWS ECS/EKS
Terraform
Grafana

Job description

Slack is seeking a senior software engineer to join the Data Ingestion Team. You will build scalable streaming and batch pipelines to ingest data from diverse sources into our Lakehouse, handling massive storage and thousands of data pipelines.

You will lead technical initiatives, mentor others, and collaborate with cross-functional partners to deliver high-quality data infrastructure. You will work with technologies like Kafka, Flink, Spark Streaming, Iceberg, Airflow, and Kubernetes to enable

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Ingestion Engineer - Streaming & Lakehouse
Senior Data Ingestion Engineer - Streaming & Lakehouse

Momentum • San Francisco (CA)

On-site
USD 180,000 - 240,000
Senior Data Ingestion Engineer – Streaming & Lakehouse
Senior Data Ingestion Engineer – Streaming & Lakehouse

Slack • Bellevue (WA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer: Streaming & Lakehouse
Senior Data Ingestion Engineer: Streaming & Lakehouse

Salesforce, Inc. • Atlanta (GA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer – Streaming & Lakehouse
Senior Data Ingestion Engineer – Streaming & Lakehouse

Showcify, Inc. • Atlanta (GA)

On-site
USD 173,000 - 260,000
Medical
Dental
Vision
+2
Senior Data Ingestion Engineer: Streaming & Lakehouse
Senior Data Ingestion Engineer: Streaming & Lakehouse

Salesforce, Inc. • Bellevue (WA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion & Lakehouse Engineer
Senior Data Ingestion & Lakehouse Engineer

Slack • Atlanta (GA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer - Streaming & Lakehouse
Senior Data Ingestion Engineer - Streaming & Lakehouse

Slack • Seattle (WA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer – Streaming & Lakehouse
Senior Data Ingestion Engineer – Streaming & Lakehouse

Salesforce, Inc. • San Francisco (CA)

On-site
USD 173,000 - 286,000
Senior Data Ingestion Engineer - Streaming & Lakehouse Lead
Senior Data Ingestion Engineer - Streaming & Lakehouse Lead

Slack Enterprise • Atlanta (GA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer - Lakehouse & Streaming
Senior Data Ingestion Engineer - Lakehouse & Streaming

100 Salesforce, Inc. • Atlanta (GA)

On-site
USD 155,000 - 190,000