Principal Data Platform Developer

CLEAResult; Austin (TX); On-site; USD 142,000 - 213,000; Full time

Job summary

CLEAResult in Austin, TX is seeking a data engineer to build and run a Databricks-based data platform, covering source ingestion, governed silver and gold layers, analytics data products, and AI-assisted pipelines.

You will work with Python, SQL and PySpark, Delta Lake, and Unity Catalog, implement CI/CD via GitHub Actions, and collaborate with stakeholders to deliver scalable data solutions for business KPIs.

Qualifications

• 3+ years in data engineering with production Databricks experience.
• Strong Python, SQL and PySpark; experience with Delta Lake and Delta Live Tables.
• Experience with Unity Catalog governance: grants, tagging, masking and row filters.
• Experience deploying data infrastructure as code (Databricks Asset Bundles, Terraform or similar) with Git-based CI/CD.
• Familiar with Salesforce data models and CRM ingestion patterns.
• Experience building or integrating LLM workflows (prompting, retrieval/RAG, model evaluation) is a strong plus.

Responsibilities

• Build and run Databricks Asset Bundles for ingestion, transform, product and orchestration jobs.
• Ingest across client orgs (Lakeflow Connect) with secure handling of PII-tagged data.
• Enforce data governance with Unity Catalog and ABAC masking.
• Develop document-processing pipelines and retrieval pipelines using foundation-model endpoints.
• Create reporting marts and data products to support KPIs and stakeholder reporting.

Skills

Databricks

Python

SQL

PySpark

Delta Lake

Unity Catalog

Terraform

CI/CD

Education

Bachelor’s degree in CS/Engineering

Tools

GitHub Actions

Service Principals

Azure

Job description

At CLEAResult, we lead the transition to a sustainable, equitable, and carbon-neutral energy-efficient future for our communities and our planet. We do that by creating a people-first culture built on trust, accountability, and transparency; where every employee – regardless of position, role, or identity is treated with respect and given an equal chance to thrive.Additionally, you will enjoy:• Medical, Dental, and Vision Insurance; we also offer a company-paid health care concierge service to help navigate our health plan to make the best decisions for you and yours• 401(k) with company match• Paid vacation, sick, personal and parental leave time• Paid Volunteer Time: giving back to our communities is important to us• Employee Recognition Program – convert your recognition points into gift cards• Employee Assistance Program – offers benefits to help you manage daily responsibilities• Access to on-demand training courses to advance further in your careerJob DescriptionSummaryBuilds and runs CLEAResult’s Databricks data platform. The work covers source ingestion, governed silver and gold layers, analytics data products, and AI-assisted pipelines.ResponsibilitiesBuild and maintain Databricks Asset Bundles (ingestion, transform, product and orchestration jobs) following the team’s bundle standards and CI/CD (dev and prod via GitHub Actions and service principals).Run Salesforce (Lakeflow Connect) ingestion across client orgs, including sandbox re-auth and field-level-security column-loss issues, without breaking PII-tagged silver tables.Enforce data governance: Unity Catalog grants, PII tagging and ABAC masking, table-level access for sensitive intermediate data.Build document-processing and retrieval pipelines that use foundation-model endpoints for classification, detection and inference.Build reporting marts and data products that support business KPIs and stakeholder reporting.Evaluate and choose LLM serving endpoints (model bake-offs, deprecation migrations).Debug failing pipelines and jobs, and document known defects and runbooks for the team.Qualifications3+ years in data engineering, with hands-on production experience on Databricks.Strong Python, SQL and PySpark; experience with Delta Lake and Delta Live Tables/Lakeflow.Experience with Unity Catalog governance: grants, tagging, column masking and row filters.Experience deploying data infrastructure as code (Databricks Asset Bundles, Terraform or similar) with Git-based CI/CD.Familiar with Salesforce data models and CRM ingestion patterns.Experience building or integrating LLM workflows (prompting, retrieval/RAG, model evaluation) is a strong plus.Working knowledge of Azure (identity, service principals, storage).Bachelor’s degree in computer science, engineering or a related field, or equivalent experience.Clear communicator who documents well and works with both technical and business stakeholders.DOT RequirementsIf applicable, meet all DOT qualification requirements and comply with all applicable federal, state, and local transportation regulations.Compensation Range$141,900.00 - $212,900.00CurrencyUSDTypeSalaryAny offered salary is determined based on internal equity, internal salary ranges, market data/ranges, applicant’s skills and prior relevant experience, certain degrees and certifications (e.g. JD/technology), for example.CLEAResult will not provide sponsorship or support for immigration status or work authorization including for international students. Applicants must be authorized to work in the country where the position is located without the need for employer sponsorship or support. Successful hires must pass pre-employment checks.Equal Opportunity EmployerAs an Equal Opportunity Employer, we are committed to ensuring equal employment opportunities for all job applicants and employees. Employment decisions are based upon job-related reasons regardless of an applicant’s race, color, religion, national origin, marital status, age, sex, gender identity, sexual orientation, status as a qualified individual with a disability or protected veteran, or any other protected status.The above job description and job requirements are not intended to be all inclusive. CLEAResult retains the right to make changes or adjustments to job descriptions and/or requirements at any time without notice.