Senior Databricks Consultant TS/SCI-CI Poly

ecsfederal; Virginia (MN); On-site; USD 175,000 - 250,000; Full time

Job summary

ECS Federal seeks a Sr. Databricks Consultant to join our Arlington, VA office, focusing on designing, optimizing, and fine-tuning Databricks environments for advanced analytics and AI-driven insights using Delta Lake, MLflow, and Spark.

Leverage cloud integration (AWS/Azure/GCP), scalable pipelines, and governance to deliver measurable improvements in data platforms. US citizenship and TS/SCI-CI poly clearance are required; Bachelor's degree or related experience preferred.

Qualifications

• Active TS/SCI-CI Poly clearance
• US citizenship required
• Production Databricks experience
• Strong Python and SQL skills
• Experience with Apache Spark
• Cloud platform experience (AWS/Azure/GCP)
• Knowledge of data governance and security

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Databricks

Python

SQL

Spark

ETL/ELT

Delta Lake

MLflow

Education

Bachelor's degree required

Tools

Databricks

Delta Lake

MLflow

Git

Job description

ECS Federal seeks a Sr. Databricks Consultant to join our Arlington, VA office, focusing on designing, optimizing, and fine-tuning Databricks environments for advanced analytics and AI-driven insights using Delta Lake, MLflow, and Spark.

Leverage cloud integration (AWS/Azure/GCP), scalable pipelines, and governance to deliver measurable improvements in data platforms. US citizenship and TS/SCI-CI poly clearance are required; Bachelor's degree or related experience preferred.