Senior Data Platform Engineer — Real-Time Pipelines

Intuit; Monroe (MI); On-site; USD 180,000 - 240,000; Full time

Benefits offered by this job

Bonus

Equity rewards

Benefits

Job summary

Intuit's Credit Karma data platform team is seeking a senior engineer to design and maintain high-throughput data frameworks and streaming pipelines. You will build Scala-based microservices and cloud-native data tools used across the engineering organization.

You will own encryption, governance, and self-service tooling, participate in architecture reviews, and contribute to observability and on-call rotations, enabling reliable, scalable data products.

Qualifications

• 7+ years of professional software engineering experience building backend services and data infrastructure.
• 7+ years of experience designing and operating high-throughput, low-latency distributed systems that process data at petabyte scale.
• 3+ years of experience with streaming and messaging platforms such as Apache Kafka, Google Pub/Sub, or equivalent.
• 3+ years of experience building data pipelines on a major cloud platform (GCP, AWS, or Azure), including services like Dataflow, BigQuery, Spanner, or their equivalents.

Responsibilities

• Design, build, and maintain high-throughput, low-latency data frameworks used across Credit Karma's engineering organization, including ETL templates, persistence libraries, and streaming data pipelines
• Develop and extend Scala-based microservices and frameworks built on Finagle, Akka Streams, and gRPC that process petabytes of data daily
• Build and optimize cloud-native data pipelines on Google Cloud Platform using Dataflow (Apache Beam), Pub/Sub, BigQuery, and Spanner
• Own and evolve our Kafka-based streaming infrastructure — designing producers, consumers, and connectors that handle hundreds of terabytes of events per day with strict latency and durability guarantees
• Build persistence frameworks that provide a unified, type-safe API for reading and writing across Spanner, MySQL, and BigQuery
• Design and implement encryption, decryption, and fine-grained access control capabilities as reusable framework features, ensuring compliance with data governance requirements
• Create self-service developer tooling — CLI tools, templates, and onboarding automation — that reduces the time for other teams to adopt the data platform from weeks to hours
• Drive technical design through architecture reviews and Technical Design Documents (TDDs), influencing decisions across the broader Data & AI organization
• Participate in on-call rotations and build observability (dashboards, alerting, metrics) into every system you ship

Skills

Scala

Java

Distributed systems

Cloud platforms

CI/CD

Git

On-call rotations

gRPC

Tools

Finagle

Akka

Dataflow

Pub/Sub

BigQuery

Spanner

Kafka

Kubernetes

Job description

Intuit's Credit Karma data platform team is seeking a senior engineer to design and maintain high-throughput data frameworks and streaming pipelines. You will build Scala-based microservices and cloud-native data tools used across the engineering organization.

You will own encryption, governance, and self-service tooling, participate in architecture reviews, and contribute to observability and on-call rotations, enabling reliable, scalable data products.