Senior Data Engineer, Databricks Lakehouse & AI Pipelines

SiloSmashers; Arlington (TX); On-site; USD 120,000 - 180,000; Full time

Job summary

SiloSmashers, Inc. is seeking a seasoned Data Engineer to help our government-facing client architect, build, and optimize high-performance data pipelines in Databricks Lakehouse environments.

You will collaborate with federal teams across platform, SRE, governance, and privacy to ensure secure, scalable data flows. The role requires 8+ years in data engineering, a Databricks Data Engineer Associate Certification, and cloud fundamentals.

Qualifications

• Eight or more years in data engineering, ETL/ELT, or distributed data processing in cloud environments.
• Public Trust clearance is required.
• Databricks Data Engineer Associate Certification.
• At least one foundational cloud certification (e.g., AWS Cloud Practitioner, Azure Fundamentals).
• Bachelor's degree or 4+ years of equivalent experience in lieu of degree.
• Preferred: Databricks Lakehouse Architect or ML/AI related certifications.
• Regular, physical attendance at customer sites.

Responsibilities

• Architect, develop, optimize, and maintain data ingestion and transformation pipelines.
• Collaborate with federal teams, platform, SRE, governance, and privacy personnel.
• Ensure secure, high-performance data pipelines in Databricks Lakehouse environments.

Skills

Databricks Lakehouse

Python

PySpark

Structured Streaming

CI/CD tooling

Git workflows

Terraform/IaC

Cloud platforms (AWS/Azure)

Security best practices

AI/ML interest

Education

Bachelor's degree in CS or related field

Equivalent work-experience (4+ years)

Tools

Databricks

GitHub Actions

Azure DevOps

Databricks Repos

Terraform

Job description

SiloSmashers, Inc. is seeking a seasoned Data Engineer to help our government-facing client architect, build, and optimize high-performance data pipelines in Databricks Lakehouse environments.

You will collaborate with federal teams across platform, SRE, governance, and privacy to ensure secure, scalable data flows. The role requires 8+ years in data engineering, a Databricks Data Engineer Associate Certification, and cloud fundamentals.