Senior Google Data Platform Engineer | Remote

K&K Global Talent Solutions; United States; Remote; USD 150.000 - 210.000; Vollzeit

Zusammenfassung

K&K Global Talent Solutions is seeking a Senior Google Data Platform Engineer in the US to lead streaming data pipelines from Pub/Sub to data marts. You will work within a pod of engineers, own end-to-end delivery, ensure data quality, and mentor junior teammates.

You will apply Dataplex concepts, perform complex SQL with BigQuery, and drive infrastructure as code with Terraform and CI/CD. The role rewards leadership and hands-on cloud expertise in a dynamic data engineering environment.

Qualifikationen

• Production streaming experience with Pub/Sub, Dataflow, Kafka/Flink/Kinesis as applicable.
• Strong Python, advanced SQL, and Apache Beam proficiency.
• Deep hands-on BigQuery knowledge: partitioning, clustering, incremental merges.

Aufgaben

• Own a source domain end-to-end from Pub/Sub to data mart.
• Confirm source-side publishing contracts with system owners and integrators.
• Build streaming pipelines with ordering, deduplication, and replay handling.
• Develop conformed Dataform models with data quality assertions.
• Lead the pod: assign work, review code, mentor on streaming concepts.
• Ensure pipelines emit structured logs/metrics for operations.
• Translate target-state design into executable build plans and align with architect.
• Lead runbooks creation and hypercare for the domain.

Kenntnisse

Python

SQL

Apache Beam

BigQuery

Dataflow

Pub/Sub

Terraform

Git CI/CD

Dataform / dbt

Leadership

Tools

Dataflow

Pub/Sub

BigQuery

Dataform

dbt

Terraform

Looker

Jobbeschreibung

Senior Google Data Platform Engineer

8--12 years data engineering, including 4 years hands-on Google Cloud Platform. Reports to the Platform Architect.

Leads the build of one or more source domains and acts as technical lead for a pod of two to four engineers. Owns delivery within the architect's frame; does not own platform-wide design or the DataOps layer.

Responsibilities

• Own a source domain end to end: Pub/Sub consumption, Dataflow ingestion, bronze landing, Dataform conformance, and the resulting data mart.
• Confirm the source-side publishing contract with system owners and third-party integrators, applying the defined onboarding pattern.
• Build streaming pipelines handling ordering, idempotency, deduplication, and late-arriving events; implement and prove DLQ, archival, and replay.
• Build conformed and mart-layer Dataform models with assertions covering agreed data quality rules; conform shared dimensions rather than forking them.
• Build and operate reconciliation against the system of record and produce the evidence package for sign-off.
• Apply Dataplex registration, policy tags, and row-level security across the domain.
• Lead the pod: assign work, review code, hold the quality bar, and mentor on streaming concepts.
• Translate the target-state design into an executable build plan; elevate architectural conflicts early rather than coding around them.
• Ensure every pipeline emits structured logs and metrics so the platform's operations layer can monitor it; write runbooks and lead hypercare for the domain.

Required

• Production streaming experience --- Pub/Sub and Dataflow, or Kafka / Flink / Kinesis --- including deduplication, ordering, and replay.
• Strong Python, advanced SQL, and Apache Beam.
• Deep hands-on BigQuery: partitioning, clustering, incremental merge patterns, cost-aware design.
• Dimensional modeling built in a real warehouse, including conformed dimensions.
• Dataform or dbt at production scale with tests or assertions and dependency management.
• Terraform, Git workflow, and CI/CD for data pipelines.
• Experience integrating a major SaaS platform as a data source.
• Track record leading a small team or owning a workstream, with judgment on which decisions are theirs and which belong to the architect.

Must Have

• Google Cloud Platform Professional Data Engineer certification; Dataplex and DLP; Analytics Hub or Looker; public sector delivery experience.