GCP Data Engineer — Onsite NYC, Databricks & BigQuery

Caliber Smart; New York (NY); On-site; USD 130,000 - 180,000; Full time

Job summary

Caliber Smart is seeking a seasoned Cloud Engineer onsite in New York, NY. You will own production Databricks work, including Delta Lake and Unity Catalog, and build robust data pipelines on Google Cloud.

Strong SQL/Python, and expertise in clean room technologies are essential. You will engage in client-facing delivery, translating business requirements into technical specs and contributing to data governance programs.

Qualifications

• 5+ years of Cloud engineering experience with Databricks and data pipelines.
• Proficient in GCP (BigQuery, Cloud Storage, Cloud Run, IAM).
• Expert SQL and strong Python for data transformation and quality automation.
• Experience with clean room technology and understanding aggregate vs row-level constraints.
• Deep knowledge of identity resolution: deterministic matching and graph assembly.
• Strong data governance knowledge in financial services (GLBA, Fair Lending, UDAAP).
• CI/CD and infrastructure-as-code for data platforms.
• Ability to translate business requirements into technical specs in client-facing contexts.

Responsibilities

• Lead production Databricks work: Delta Lake, Unity Catalog, Lakeflow/DLT pipelines, structured streaming, and SQL warehouses.
• Implement and optimize data platforms on Google Cloud.
• Collaborate with clients to translate business needs into technical specifications.

Skills

Cloud engineering

Databricks

SQL

Python

Data pipelines

GCP

BigQuery

Data quality automation

Identity resolution

CI/CD

Infrastructure as code

Client-facing

Tools

BigQuery

Cloud Storage

Cloud Run

IAM

Job description

Caliber Smart is seeking a seasoned Cloud Engineer onsite in New York, NY. You will own production Databricks work, including Delta Lake and Unity Catalog, and build robust data pipelines on Google Cloud.

Strong SQL/Python, and expertise in clean room technologies are essential. You will engage in client-facing delivery, translating business requirements into technical specs and contributing to data governance programs.