Senior Data Ingestion Engineer: Streaming & Lakehouse

Salesforce, Inc.

Atlanta (GA)

On-site

USD 173,000 - 260,000

Full time

7 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Salesforce, Inc. is seeking a Senior Software Engineer to join the Data Ingestion Team. You will design scalable streaming and batch pipelines, and build Lakehouse solutions to enable production use cases for customers.

You will collaborate with cross-functional partners and mentor engineers, driving data-driven decisions at scale. You will leverage Kafka, Spark, Airflow, and Lakehouse technologies to deliver robust data platforms while ensuring reliability and performance in a fast-growing

Qualifications

  • 7+ years of software/data engineering experience with streaming and lakehouse tech.
  • Hands-on experience building batch data pipelines with Spark, Airflow, EMR, S3.
  • In-depth knowledge of SQL, Python, Java/Scala, Go.
  • Experience building robust distributed microservices with Kubernetes, Docker, AWS ECS/EKS, Terraform, Grafana.

Responsibilities

  • Design scalable streaming and batch pipelines for ingesting and processing data.
  • Design and implement Lakehouse solutions for production use cases.
  • Improve reliability and performance of services and pipelines.
  • Automate dataset lifecycle including schema evolution and migration.
  • Lead technical initiatives end to end and collaborate with cross-functional teams.
  • Coach and mentor engineers across the team and org.
  • Provide feedback on technical designs.

Skills

Kafka
Kafka Connect
Flink
Spark Streaming
Iceberg
Hudi
Delta Lake
Airflow
EMR
S3
SQL
Python
Java/Scala
Go
Kubernetes
Docker
AWS ECS/EKS
Terraform
Grafana

Tools

Kafka
Spark
Airflow
ECS/EKS
Terraform

Job description

Salesforce, Inc. is seeking a Senior Software Engineer to join the Data Ingestion Team. You will design scalable streaming and batch pipelines, and build Lakehouse solutions to enable production use cases for customers.

You will collaborate with cross-functional partners and mentor engineers, driving data-driven decisions at scale. You will leverage Kafka, Spark, Airflow, and Lakehouse technologies to deliver robust data platforms while ensuring reliability and performance in a fast-growing

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Ingestion Engineer – Streaming & Lakehouse
Senior Data Ingestion Engineer – Streaming & Lakehouse

Showcify, Inc. • Atlanta (GA)

On-site
USD 173,000 - 260,000
Medical
Dental
Vision
+2
Senior Data Ingestion Engineer: Streaming & Lakehouse
Senior Data Ingestion Engineer: Streaming & Lakehouse

Salesforce, Inc. • Bellevue (WA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer – Streaming & Lakehouse
Senior Data Ingestion Engineer – Streaming & Lakehouse

Salesforce, Inc. • San Francisco (CA)

On-site
USD 173,000 - 286,000
Senior Data Ingestion Engineer - Streaming & Lakehouse Lead
Senior Data Ingestion Engineer - Streaming & Lakehouse Lead

Slack Enterprise • Atlanta (GA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer, Streaming & Lakehouse
Senior Data Ingestion Engineer, Streaming & Lakehouse

Salesforce, Inc. • Seattle (WA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer - Lakehouse & Streaming
Senior Data Ingestion Engineer - Lakehouse & Streaming

100 Salesforce, Inc. • Atlanta (GA)

On-site
USD 155,000 - 190,000
Senior Data Ingestion Engineer – Streaming & Lakehouse
Senior Data Ingestion Engineer – Streaming & Lakehouse

Slack • Bellevue (WA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion & Lakehouse Engineer
Senior Data Ingestion & Lakehouse Engineer

Slack • Atlanta (GA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer - Streaming & Lakehouse
Senior Data Ingestion Engineer - Streaming & Lakehouse

Slack • Seattle (WA)

On-site
USD 173,000 - 260,000
Senior Data Ingestion Engineer - Lakehouse & Streaming
Senior Data Ingestion Engineer - Lakehouse & Streaming

Slack • San Francisco (CA)

On-site
USD 173,000 - 286,000