Remote Senior Databricks Consultant with Secret Clearance

ecsfederal; Virginia (MN); Hybrid; USD 175,000 - 250,000; Full time

Benefits offered by this job

Active Secret Clearance

US Citizenship required

Job summary

ECS Federal is seeking a Sr. Databricks Consultant to work in our Arlington, VA office/remotely.

You will design, optimize, and fine-tune Databricks environments for advanced analytics, ML, and AI insights, leveraging Delta Lake, MLflow, and Databricks ML to maximize performance and value. The role supports Professional Services and Managed Cybersecurity Services, focusing on data pipelines, scalable model training, and analytics in the Databricks ecosystem.

Qualifications

• Strong proficiency in Python and SQL for data engineering and analytics.
• Experience with Databricks in production environments.
• Knowledge of Spark-based data processing and data lakehouse architectures.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Python

SQL

Apache Spark

Databricks

Delta Lake

Education

Bachelor’s degree in Computer Science or related field

Tools

Git

CI/CD

Job description

ECS Federal is seeking a Sr. Databricks Consultant to work in our Arlington, VA office/remotely.

You will design, optimize, and fine-tune Databricks environments for advanced analytics, ML, and AI insights, leveraging Delta Lake, MLflow, and Databricks ML to maximize performance and value. The role supports Professional Services and Managed Cybersecurity Services, focusing on data pipelines, scalable model training, and analytics in the Databricks ecosystem.