Staff Data Engineer: Real‑Time Data Pipelines & Platform

Intuit; Livonia (MI); On-site; USD 150,000 - 230,000; Full time

Job summary

Intuit, in Livonia, MI, seeks an experienced data infra engineer to advance the end-to-end data platform. You will design high-throughput data frameworks, extend Scala-based microservices, and build cloud-native pipelines on Google Cloud with Dataflow, Pub/Sub, BigQuery, and Spanner.

You will own streaming infrastructure using Kafka, craft encryption and access controls, and create tooling and observability to support hundreds of terabytes daily and real-time product experiences.

Qualifications

• 7+ years of software engineering experience on backend services and data infrastructure.
• Proficiency in Scala/Java and building distributed systems at scale.
• Experience with streaming/messaging and cloud data platforms.

Responsibilities

• Design, build, and maintain high-throughput data frameworks used across Credit Karma's engineering organization, including ETL templates, persistence libraries, and streaming data pipelines
• Develop and extend Scala-based microservices and frameworks built on Finagle, Akka Streams, and gRPC that process petabytes of data daily
• Build and optimize cloud-native data pipelines on Google Cloud Platform using Dataflow (Apache Beam), Pub/Sub, BigQuery, and Spanner
• Own and evolve our Kafka-based streaming infrastructure — designing producers, consumers, and connectors that handle hundreds of terabytes of events per day with strict latency and durability guarantees
• Create self-service developer tooling — CLI tools, templates, and onboarding automation — that reduces the time for other teams to adopt the data platform from weeks to hours

Skills

Scala

Java

Distributed systems

CI/CD

Observability

Tools

Kafka

Pub/Sub

Dataflow

BigQuery

Spanner

gRPC

Akka Streams

Finagle

Job description

Intuit, in Livonia, MI, seeks an experienced data infra engineer to advance the end-to-end data platform. You will design high-throughput data frameworks, extend Scala-based microservices, and build cloud-native pipelines on Google Cloud with Dataflow, Pub/Sub, BigQuery, and Spanner.

You will own streaming infrastructure using Kafka, craft encryption and access controls, and create tooling and observability to support hundreds of terabytes daily and real-time product experiences.