Senior Data Platform Engineer — Scalable Data Pipelines

Intuit; Bloomington (IL); On-site; USD 160,000 - 210,000; Full time

Job summary

Intuit in Bloomington, IL seeks a Senior Data Engineer to own the end-to-end data platform, processing hundreds of terabytes daily. You will build scalable data frameworks and JVM-based services, interfacing with Kafka, Pub/Sub, Dataflow, BigQuery, and Spanner to reliably ship data to product teams.

Expect to influence architectural choices, improve observability, and mentor engineers while contributing to on-call rotations in a fast-paced, data-driven environment that prioritizes reliability

Qualifications

• 7+ years of professional software engineering experience building backend services and data infrastructure in JVM languages.
• 7+ years designing high-throughput, low-latency distributed systems that process data at petabyte scale.
• 3+ years with streaming/messaging platforms such as Apache Kafka, Google Pub/Sub, or equivalent.
• 3+ years building data pipelines on a major cloud platform (GCP/AWS/Azure) with Dataflow, BigQuery, Spanner, or equivalents.
• Experience with RPC frameworks such as Finagle, gRPC, or Akka.
• Strong CI/CD, Git, code review, and automated testing practices.

Responsibilities

• Design, build, and maintain high-throughput, low-latency data frameworks used across Credit Karma's engineering organization, including ETL templates, persistence libraries, and streaming data pipelines
• Develop and extend Scala-based microservices and frameworks built on Finagle, Akka Streams, and gRPC that process petabytes of data daily
• Build and optimize cloud-native data pipelines on Google Cloud Platform using Dataflow (Apache Beam), Pub/Sub, BigQuery, and Spanner
• Own and evolve our Kafka-based streaming infrastructure — designing producers, consumers, and connectors that handle hundreds of terabytes of events per day with strict latency and durability guarantees
• Design and implement encryption, decryption, and fine-grained access control capabilities as reusable framework features
• Create self-service developer tooling — CLI tools, templates, and onboarding automation — that reduces onboarding time from weeks to hours

Skills

Scala

Java

Distributed systems

Kafka

Pub/Sub

Dataflow

BigQuery

Spanner

gRPC

Finagle

Akka

CI/CD

Git

Code review

Automated testing

Kubernetes

Tools

Kubernetes

Job description

Intuit in Bloomington, IL seeks a Senior Data Engineer to own the end-to-end data platform, processing hundreds of terabytes daily. You will build scalable data frameworks and JVM-based services, interfacing with Kafka, Pub/Sub, Dataflow, BigQuery, and Spanner to reliably ship data to product teams.

Expect to influence architectural choices, improve observability, and mentor engineers while contributing to on-call rotations in a fast-paced, data-driven environment that prioritizes reliability