Senior Databricks Data Engineer: Delta Lake & Multi-Tenant

United States Digital Space LLC; United States; Remote; USD 100,000 - 130,000; Full time

Benefits offered by this job

Excellent healthcare package

Unlimited Paid Time Off

401(k) match

Job summary

United States Digital Space LLC is seeking a Senior Data Engineer to enhance the Sugar Predict platform. You will drive the production reliability of Databricks pipelines to optimize costs and support customer onboarding.

The ideal candidate will have over 4 years of data engineering experience, robust skills in PySpark and SQL, and expertise in working within multi-tenant environments. The position offers excellent benefits, including unlimited paid time off and a comprehensive healthcare package.

Qualifications

• 4+ years of data engineering experience.
• Proficiency in PySpark, SQL, and Python.
• Experience supporting large-scale multi-tenant architectures.

Responsibilities

• Own Databricks production support.
• Maintain and report on SLA performance metrics.
• Design and build high-performance Databricks pipelines.

Skills

PySpark

SQL

Python

Data governance

Collaboration

Education

4+ years of data engineering experience

Experience with Delta Lake

Hands-on experience with Databricks

Tools

Databricks

PostgreSQL

Microsoft SQL Server

Job description

United States Digital Space LLC is seeking a Senior Data Engineer to enhance the Sugar Predict platform. You will drive the production reliability of Databricks pipelines to optimize costs and support customer onboarding.

The ideal candidate will have over 4 years of data engineering experience, robust skills in PySpark and SQL, and expertise in working within multi-tenant environments. The position offers excellent benefits, including unlimited paid time off and a comprehensive healthcare package.