Senior Data Ingestion Engineer - Streaming & Lakehouse

Slack; Seattle (WA); On-site; USD 173,000 - 260,000; Full time

Job summary

Salesforce, hosting Slack's data ingestion focus, seeks a Senior Software Engineer to lead streaming and lakehouse initiatives within the Data Ingestion Team. You will build scalable data pipelines and contribute to production-grade data services used by thousands of customer workloads.

Requires 7+ years in software/data engineering, strong SQL/Python/Java/Go skills, and hands-on experience with Kafka, Spark, Airflow, and cloud-based data platforms. Hybrid / Seattle area preferred.

Qualifications

• U.S. citizenship and willing to undergo a background check for GovSlack authorization.
• 7+ years of software/data engineering experience, including experience with building applications using Streaming and Lakehouse technologies, e.g. Kafka/Kafka Connect, Flink/Spark Streaming, Iceberg/Hudi/Delta or equivalent
• Hands on experience and knowledge on building and maintaining batch data pipelines using Spark, Airflow, EMR, S3 or equivalent
• You are proficient in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go or equivalent
• You are skilled at crafting and building robust distributed microservices with tools like Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana, etc.

Responsibilities

• Design and develop highly scalable and resilient streaming and batch pipelines for ingesting and processing structured and unstructured datasets
• Design and implement Slack’s Lakehouse solutions and enable production use cases for customers
• Improve the reliability and performance of the services/pipelines through AI assisted and/or Agentic solutions and tools.
• Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration).
• As one of the tech leads, comfortably collaborate with cross functional partners and lead technical initiatives independently end to end.
• Be a role model and a multiplier, coaching and mentoring other engineers across the team and the org.
• Write, review, or provide feedback on a technical design proposal from others.

Skills

Streaming and Lakehouse experience

Data ingestion

Distributed systems

SQL

Python

Java/Scala

Go

Kubernetes

Docker

AWS ECS/EKS

Terraform

Grafana

Tools

Kafka

Kafka Connect

Flink

Spark Streaming

Iceberg

Hudi

Delta

Spark

Airflow

EMR

S3

Kubernetes

Docker

AWS ECS/EKS

Terraform

Grafana

Job description

Salesforce, hosting Slack's data ingestion focus, seeks a Senior Software Engineer to lead streaming and lakehouse initiatives within the Data Ingestion Team. You will build scalable data pipelines and contribute to production-grade data services used by thousands of customer workloads.

Requires 7+ years in software/data engineering, strong SQL/Python/Java/Go skills, and hands-on experience with Kafka, Spark, Airflow, and cloud-based data platforms. Hybrid / Seattle area preferred.