Data Engineer (Databricks) - Remote, AI-Powered Pipelines

Full Tilt Data, LLC; United States; On-site; USD 110,000 - 160,000; Full time

Benefits offered by this job

Health benefits

Discretionary bonuses

Reimbursement for professional develop

Job summary

Full Tilt Data, LLC is a trusted data, analytics, and IT consulting firm serving federal health-related programs. We seek a Mid-Level Data Engineer, Databricks to build scalable lakehouse capabilities, data pipelines, and access-control mechanisms for a high-impact federal program.

You will work on Data modeling, Delta Sharing, and AI-enabled search features, with occasional in-person meetings quarterly. A Federal Public Trust clearance is required or in process.

Qualifications

• 3-5+ years of data engineering experience, with 1-2 years in Databricks.
• Strong Python and PySpark skills for building data pipelines.
• Knowledge of star schema, fact/dimension tables, and dimensional modeling.
• Experience with SQL and structured/semi-structured data sources.
• Familiarity with Git-based CI/CD deployment workflows.
• Ability to obtain/maintain a Federal Public Trust clearance.
• Comfortable in a fast-paced, collaborative team environment.

Responsibilities

• Design, build, and maintain data pipelines on Databricks using Python/PySpark.
• Develop canonical data models (UDM) and star schemas for onboarding datasets.
• Implement Retrieval-Augmented Generation and vector search for AI-driven queries.
• Contribute to DABs and CI/CD pipelines for deployment consistency.
• Create Python integrations linking OPA/Rego policies to Databricks/Spark.
• Support Delta Sharing, OCR workflows, and Databricks Apps.
• Package patterns into reusable references for agency use.
• Participate in weekly standups and monthly status reports.

Skills

Python

PySpark

Dimensional data modeling

SQL

CI/CD

Fast-paced environment

Tools

Databricks

Git-based workflows

OPA / Rego

Databricks Asset Bundles (DAB)

Delta Sharing

Unity Catalog

Vector search tooling

Job description

Full Tilt Data, LLC is a trusted data, analytics, and IT consulting firm serving federal health-related programs. We seek a Mid-Level Data Engineer, Databricks to build scalable lakehouse capabilities, data pipelines, and access-control mechanisms for a high-impact federal program.

You will work on Data modeling, Delta Sharing, and AI-enabled search features, with occasional in-person meetings quarterly. A Federal Public Trust clearance is required or in process.