Databricks Engineer

Jobtailor; Washington (District of Columbia); On-site; USD 120,000 - 170,000; Full time

Job summary

Jobtailor seeks a data/analytics engineer to design, build, and operate scalable data solutions for government missions in the Washington, DC area. You will apply AI-enabled analytics and ML techniques to support critical operations and decision-making.

The role requires 3+ years in data or analytics engineering, strong Databricks experience, PySpark/Spark SQL, and proficiency with Python and cloud data services (AWS/Azure/GCP). A Public Trust suitability may be required.

Qualifications

• 3+ years of experience in data engineering or analytics engineering roles
• 2+ years of experience with the Databricks platform
• Experience in PySpark and Spark SQL
• Experience with Databricks clusters, jobs or workflows, Delta Lake, and Unity Catalog in production environments
• Experience integrating Databricks with CI / CD pipelines and enterprise SDLC tooling
• Knowledge of Python for data engineering and ML workflows
• Knowledge of cloud platforms such as AWS, Azure, or GCP and their data services
• Ability to operate effectively in structured, compliance-driven government environments
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
• Bachelor’s degree

Responsibilities

• Design, build, and operate scalable data and analytics solutions supporting government mission needs
• Apply AI-enabled analytics and machine learning techniques to solve operational and decision-support problems

Skills

Databricks

PySpark

Spark SQL

Python

CI/CD pipelines

Cloud data services

Education

Bachelor’s degree

Tools

Delta Lake

Unity Catalog

AWS

Azure

GCP

Job description

Responsibilities

• Design, build, and operate scalable data and analytics solutions supporting government mission needs
• Apply AI-enabled analytics and machine learning techniques to solve operational and decision-support problems

Requirements

• 3+ years of experience in data engineering or analytics engineering roles
• 2+ years of experience with the Databricks platform
• Experience in PySpark and Spark SQL
• Experience with Databricks clusters, jobs or workflows, Delta Lake, and Unity Catalog in production environments
• Experience integrating Databricks with CI / CD pipelines and enterprise SDLC tooling
• Knowledge of Python for data engineering and ML workflows
• Knowledge of cloud platforms such as AWS, Azure, or GCP and their data services
• Ability to operate effectively in structured, compliance-driven government environments
• Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
• Bachelor’s degree