Senior Databricks Data Engineer — Remote, Federal Programs

Full Tilt Data, LLC; United States; Hybrid; USD 120,000 - 170,000; Full time

Benefits offered by this job

Health benefits

Discretionary bonuses

Reimbursement for professional dev/trn

Job summary

Full Tilt Data, LLC is seeking a Senior Data Engineer specializing in Databricks to deliver secure, scalable data solutions for a federal program. The role focuses on Databricks/PySpark pipelines, data modeling, and AI-enabled search capabilities, with a background check requirement and quarterly in-person office visits.

Remote work is allowed with periodic in-person meetings; industry-leading data governance, CI/CD, and Delta Sharing practices are emphasized, along with mentoring a growing team

Qualifications

• 7–10+ years in data engineering with 3–4+ years on Databricks/PySpark.
• Leadership of complex pipelines in production Databricks environments.
• Strong dimensional data modeling with star schema and fact/dimension design.
• Hands-on RAG or vector search in production or near-production.
• CI/CD design and Databricks Asset Bundles (DAB) experience.
• Experience with policy-as-code (OPA/Rego) integration is a plus.

Responsibilities

• Own and drive architecture decisions for Databricks pipelines for performance and reliability.
• Redesign star schema and unified data model structures, including fact/dimension tables.
• Architect and implement RAG and vector search for AI-assisted querying.
• Define and enforce DAB and CI/CD best practices across the team.
• Integrate OPA/Rego with Databricks and Spark for dynamic access control.
• Establish patterns for Delta Sharing, OCR, and Databricks Apps.
• Mentor engineers, review designs, and support capacity rebuilding.
• Represent engineering in standups and client technical discussions.

Skills

Databricks/PySpark

Python

SQL

Mentoring

CI/CD

Data modeling

OPA/Rego (policy-as-code)

Tools

Databricks

Unity Catalog

Job description

Full Tilt Data, LLC is seeking a Senior Data Engineer specializing in Databricks to deliver secure, scalable data solutions for a federal program. The role focuses on Databricks/PySpark pipelines, data modeling, and AI-enabled search capabilities, with a background check requirement and quarterly in-person office visits.

Remote work is allowed with periodic in-person meetings; industry-leading data governance, CI/CD, and Delta Sharing practices are emphasized, along with mentoring a growing team