Senior Databricks Consultant — Remote/Arlington Data & ML

ECS; Richmond (VA); Hybrid; USD 175,000 - 250,000; Full time

Job summary

ECS Federal LLC seeks a Sr. Databricks Consultant to design, optimize, and tune Databricks environments for advanced analytics, ML, and AI-driven insights. Arlington, VA with remote option.

You'll implement Delta Lake, MLflow, and Databricks ML, build scalable ETL pipelines, optimize workloads, and ensure data governance on cloud platforms (AWS/Azure/GCP). US citizenship and active public trust clearance preferred.

Qualifications

• . Must have active public trust clearance and hold Databricks production experience.
• . Proficient in Python and/or SQL for data engineering.
• . Strong experience with Apache Spark and data lakehouse architectures.
• . Knowledge of cloud data platforms (AWS S3, Azure Data Lake, GCP Storage).
• . Hands-on in building ETL/ELT pipelines and data modeling.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and stakeholders to deliver datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Public Trust Clearance

Databricks production experience

Python/SQL

Apache Spark

Data lakehouse

Cloud platforms (AWS/Azure/GCP)

ETL/ELT pipelines

Data modeling & quality

CI/CD & Git

Travel readiness

US Citizen

Bachelor's degree

Education

Bachelor's degree

Tools

Terraform

ARM

CloudFormation

Job description

ECS Federal LLC seeks a Sr. Databricks Consultant to design, optimize, and tune Databricks environments for advanced analytics, ML, and AI-driven insights. Arlington, VA with remote option.

You'll implement Delta Lake, MLflow, and Databricks ML, build scalable ETL pipelines, optimize workloads, and ensure data governance on cloud platforms (AWS/Azure/GCP). US citizenship and active public trust clearance preferred.