Principal Data Platform Developer

CLEAResult Consulting; United States; On-site; USD 142,000 - 213,000; Full time

Job summary

CLEAResult builds and runs its Databricks data platform, covering source ingestion, governed silver and gold layers, analytics data products, and AI-assisted pipelines. The role includes managing bundle standards, CI/CD, and secure access controls to protect sensitive data.

You will work across ingestion, transformation, and orchestration tasks, and help shape reporting marts and KPIs for clients. A strong background in data engineering and governance is essential.

Qualifications

• 3+ years in data engineering with production Databricks experience.
• Strong Python, SQL and PySpark skills; Delta Lake and Delta Live Tables/Lakeflow experience.
• Experience with Unity Catalog governance: grants, tagging, masking, and row filters.
• Infrastructure as code for data platforms (Databricks Asset Bundles, Terraform or similar) with Git‑based CI/CD.
• Familiarity with Salesforce data models and CRM ingestion patterns.
• Experience building/integrating LLM workflows (prompting, retrieval/RAG, model evaluation).
• Working knowledge of Azure (identity, service principals, storage).
• Bachelor's degree in computer science, engineering or related field, or equivalent experience.
• Clear communicator who documents well with technical and business stakeholders.

Responsibilities

• Build and maintain Databricks Asset Bundles (ingestion, transform, product and orchestration jobs).
• Run Salesforce data ingestion across client orgs, handling re-auth and field-level issues without breaking PII-tagged tables.
• Enforce Unity Catalog governance: grants, tagging, masking, and access controls for sensitive data.
• Develop document-processing and retrieval pipelines using foundation-model endpoints for classification and inference.
• Create reporting marts and data products to support KPIs and stakeholder reporting.
• Evaluate LLM serving endpoints and perform model bake-offs or migrations.
• Debug failing pipelines, document defects, and maintain runbooks for the team.

Skills

Databricks

Python

SQL

PySpark

Delta Lake

Unity Catalog

Terraform

GitHub Actions

Salesforce data

LLM workflows

Education

Bachelor's degree in CS/Engineering

Tools

Terraform

GitHub Actions

Azure

Job description

At CLEAResult, we lead the transition to a sustainable, equitable, and carbon‑neutral energy‑efficient future for our communities and our planet. We do that by creating a people‑first culture built on trust, accountability, and transparency; where every employee - regardless of position, role, or identity is treated with respect and given an equal chance to thrive.

Additionally, you will enjoy:

• Medical, Dental, and Vision Insurance; we also offer a company‑paid health care concierge service to help navigate our health plan to make the best decisions for you and yours
• 401(k) with company match
• Paid vacation, sick, personal and parental leave time
• Paid Volunteer Time: giving back to our communities is important to us
• Employee Recognition Program - convert your recognition points into gift cards
• Employee Assistance Program - offers benefits to help you manage daily responsibilities
• Access to on‑demand training courses to advance further in your career

Job Description

Summary

Builds and runs CLEAResult's Databricks data platform. The work covers source ingestion, governed silver and gold layers, analytics data products, and AI‑assisted pipelines.

Responsibilities

• Build and maintain Databricks Asset Bundles (ingestion, transform, product and orchestration jobs) following the team's bundle standards and CI/CD (dev and prod via GitHub Actions and service principals).
• Run Salesforce (Lakeflow Connect) ingestion across client orgs, including sandbox re‑auth and field‑level‑security column‑loss issues, without breaking PII‑tagged silver tables.
• Enforce data governance: Unity Catalog grants, PII tagging and ABAC masking, table‑level access for sensitive intermediate data.
• Build document‑processing and retrieval pipelines that use foundation‑model endpoints for classification, detection and inference.
• Build reporting marts and data products that support business KPIs and stakeholder reporting.
• Evaluate and choose LLM serving endpoints (model bake‑offs, deprecation migrations).
• Debug failing pipelines and jobs, and document known defects and runbooks for the team.

Qualifications

• 3+ years in data engineering, with hands‑on production experience on Databricks.
• Strong Python, SQL and PySpark; experience with Delta Lake and Delta Live Tables/Lakeflow.
• Experience with Unity Catalog governance: grants, tagging, column masking and row filters.
• Experience deploying data infrastructure as code (Databricks Asset Bundles, Terraform or similar) with Git‑based CI/CD.
• Familiar with Salesforce data models and CRM ingestion patterns.
• Experience building or integrating LLM workflows (prompting, retrieval/RAG, model evaluation) is a strong plus.
• Working knowledge of Azure (identity, service principals, storage).
• Bachelor's degree in computer science, engineering or a related field, or equivalent experience.
• Clear communicator who documents well and works with both technical and business stakeholders.

DOT Requirements

If applicable, meet all DOT qualification requirements and comply with all applicable federal, state, and local transportation regulations.

Compensation Range

$141,900.00 - $212,900.00 Currency

USD Type

Salary

Any offered salary is determined based on internal equity, internal salary ranges, market data/ranges, applicant's skills and prior relevant experience, certain degrees and certifications (e.g. JD/technology), for example.

CLEAResult will not provide sponsorship or support for immigration status or work authorization including for international students. Applicants must be authorized to work in the country where the position is located without the need for employer sponsorship or support. Successful hires must pass pre‑employment checks.

Equal Opportunity Employer

As an Equal Opportunity Employer, we are committed to ensuring equal employment opportunities for all job applicants and employees. Employment decisions are based upon job‑related reasons regardless of an applicant’s race, color, religion, national origin, marital status, age, sex, gender identity, sexual orientation, status as a qualified individual with a disability or protected veteran, or any other protected status.

The above job description and job requirements are not intended to be all inclusive. CLEAResult retains the right to make changes or adjustments to job descriptions and/or requirements at any time without notice.