GCP Data engineer with Databricks exp- New York , NY- Fulltime Role

Caliber Smart; New York (NY); On-site; USD 130,000 - 180,000; Full time

Job summary

Caliber Smart is seeking a seasoned Cloud Engineer onsite in New York, NY. You will own production Databricks work, including Delta Lake and Unity Catalog, and build robust data pipelines on Google Cloud.

Strong SQL/Python, and expertise in clean room technologies are essential. You will engage in client-facing delivery, translating business requirements into technical specs and contributing to data governance programs.

Qualifications

• 5+ years of Cloud engineering experience with Databricks and data pipelines.
• Proficient in GCP (BigQuery, Cloud Storage, Cloud Run, IAM).
• Expert SQL and strong Python for data transformation and quality automation.
• Experience with clean room technology and understanding aggregate vs row-level constraints.
• Deep knowledge of identity resolution: deterministic matching and graph assembly.
• Strong data governance knowledge in financial services (GLBA, Fair Lending, UDAAP).
• CI/CD and infrastructure-as-code for data platforms.
• Ability to translate business requirements into technical specs in client-facing contexts.

Responsibilities

• Lead production Databricks work: Delta Lake, Unity Catalog, Lakeflow/DLT pipelines, structured streaming, and SQL warehouses.
• Implement and optimize data platforms on Google Cloud.
• Collaborate with clients to translate business needs into technical specifications.

Skills

Cloud engineering

Databricks

SQL

Python

Data pipelines

GCP

BigQuery

Data quality automation

Identity resolution

CI/CD

Infrastructure as code

Client-facing

Tools

BigQuery

Cloud Storage

Cloud Run

IAM

Job description

Job Description

Duration: Fulltime

Location: New York, NY (Onsite)

GC and USC only

5+ years of Cloud engineering experience, including production Databricks work: Delta Lake, Unity Catalog, Lakeflow/DLT pipelines, structured streaming, and SQL warehouses.

Working GCP fluency - BigQuery, Cloud Storage, Cloud Run, IAM (Nice to have experience supporting Databricks on Google Cloud).

Expert-level SQL and strong Python for transformation logic and data-quality automation.

Hands-on experience with at least one clean room technology, with a real understanding of aggregate versus row-level constraints.

Deep understanding of identity resolution: deterministic matching, probabilistic graph construction, household-level aggregation, and device graph assembly.

Strong PII governance knowledge in financial services: data residency, consent frameworks, GLBA, Fair Lending, and UDAAP.

CI/CD and infrastructure-as-code experience for data platforms.

Ability to operate in client-facing consulting delivery contexts - translating business requirements into technical specifications.