Senior Data Ingestion & Lakehouse Engineer

Slack; Atlanta (GA); On-site; USD 173,000 - 260,000; Full time

Job summary

Salesforce’s Slack team is seeking a Senior Software Engineer to drive data ingestion on the Lakehouse platform. You will design scalable streaming and batch pipelines, enable lakehouse production use cases, and push for reliable, high-performance data services.

You will mentor engineers, lead technical initiatives, and collaborate with cross-functional partners to deliver high-impact data solutions. The role emphasizes scale, reliability, and AI-assisted tooling, with opportunities to shape

Qualifications

• 7+ years of software/data engineering experience with streaming and lakehouse technologies.
• Hands-on experience building and maintaining batch data pipelines using Spark, Airflow, EMR, S3 or equivalents.
• Proficient in object-oriented and/or functional programming languages: SQL, Python, Java/Scala, Go.
• Skilled at building robust distributed microservices with Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana.

Responsibilities

• Design and develop highly scalable and resilient streaming and batch pipelines for ingesting and processing structured and unstructured datasets.
• Design and implement Slack’s Lakehouse solutions and enable production use cases for customers.
• Improve the reliability and performance of the services/pipelines through AI assisted and/or Agentic solutions and tools.
• Automate and handle the lifecycle of datasets (schema evolution, metadata management, change and backfill management, deprecation and migration).
• As one of the tech leads, collaborate with cross functional partners and lead technical initiatives end to end.
• Be a role model and a multiplier, coaching and mentoring other engineers across the team and the org.
• Write, review, or provide feedback on a technical design proposal from others.

Skills

Kafka

Kafka Connect

Flink

Spark Streaming

Iceberg

Hudi

Delta

Spark

Airflow

S3

SQL

Python

Java/Scala

Go

Kubernetes

Docker

AWS ECS

AWS EKS

Terraform

Grafana

Job description

Salesforce’s Slack team is seeking a Senior Software Engineer to drive data ingestion on the Lakehouse platform. You will design scalable streaming and batch pipelines, enable lakehouse production use cases, and push for reliable, high-performance data services.

You will mentor engineers, lead technical initiatives, and collaborate with cross-functional partners to deliver high-impact data solutions. The role emphasizes scale, reliability, and AI-assisted tooling, with opportunities to shape