Senior Data Platform Engineer – Lakehouse & AI (Remote)

Climb; United States; Remote; USD 120,000 - 160,000; Full time

Benefits offered by this job

MacBook Pro

Health insurance

Flexible PTO

Development budget

Certifications bonuses

Conference access

Leadership access

Remote-first

Job summary

Climb is a Data and AI consultancy partnering with enterprises to design, build, and operate modern data platforms and production AI systems. You will own data engineering workstreams from discovery through production and handoff, delivering scalable lakehouse solutions.

In this hands-on role you’ll work with clients to translate business requirements into technically sound data pipelines using Databricks, Delta Lake, and cloud services.

Qualifications

• 6+ years in data engineering or analytics engineering.
• Advanced experience building production data pipelines with Apache Spark (PySpark and SQL).
• Hands-on production experience with Databricks (Delta Lake, Jobs, Workflows, Unity Catalog).
• Deep experience with at least one major cloud (AWS, Azure, or GCP).
• Strong SQL and data modeling fundamentals.
• A track record of building and operating production-grade data pipelines, not just prototypes.
• Comfortable working directly with client stakeholders to translate business requirements into technical solutions.
• Demonstrated ability to independently own a data engineering workstream from design through production.

Responsibilities

• Own one or more data engineering workstreams, from technical design through production deployment and handoff.
• Design and implement scalable data models and lakehouse architectures, including medallion patterns where appropriate.
• Optimize performance and cost across Databricks and the underlying cloud: you treat compute spend as your problem, not someone else’s.
• Orchestrate workflows using Databricks Workflows, Delta Live Tables, or equivalent tooling.
• Implement governance, security, observability, and lineage with Unity Catalog, and stand up CI/CD for data.
• Design and build AI-ready data platforms that enable reliable analytics, machine learning, and agentic applications.
• Work directly with client stakeholders to gather requirements and translate them into technical solutions.
• Review code, mentor junior engineers, and maintain high engineering standards across your workstreams.
• Contribute reusable accelerators, frameworks, and best practices back to the practice.

Skills

Data engineering

PySpark / Spark

Databricks

Cloud platforms (AWS/Azure/GCP)

SQL & data modeling

Production pipelines

Tools

Delta Live Tables

dbt

Airflow

Job description

Climb is a Data and AI consultancy partnering with enterprises to design, build, and operate modern data platforms and production AI systems. You will own data engineering workstreams from discovery through production and handoff, delivering scalable lakehouse solutions.

In this hands-on role you’ll work with clients to translate business requirements into technically sound data pipelines using Databricks, Delta Lake, and cloud services.