Senior Databricks Consultant - Pipelines, ML & Cloud ETL

ECS Corporate Services; Fairfax (VA); On-site; USD 175,000 - 250,000; Full time

Benefits offered by this job

TS/SCI-FSP Clearance

Travel to customer sites

Job summary

ECS Corporate Services in Arlington, VA is seeking a Sr. Databricks Consultant to design, optimize, and fine-tune Databricks environments for advanced analytics, ML, and AI-driven insights.

You will lead data pipeline optimization, scalable model training, and collaborate with clients to deliver measurable improvements using Delta Lake, MLflow, and Databricks ML. This role includes security/compliance focus and requires US citizenship per contract.

Qualifications

• Active TS/SCI-FSP Clearance.
• Proven experience with Databricks in production.
• Strong proficiency in Python and SQL for data engineering.
• Experience with Apache Spark for distributed data processing.
• Knowledge of data lakehouse architecture and best practices.
• Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
• Hands-on experience building and managing ETL/ELT pipelines.
• Strong understanding of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD pipelines and version control (Git).
• Ability to travel, as needed, to customer sites.
• Must be a US Citizen per contract.
• Bachelor's degree; preferably in Computer Science, Information Security, or a related field.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Python

SQL

Apache Spark

Data modeling

Data quality

CI/CD

Git

Education

Bachelor's degree in Computer Science, Information Security, or related field

Tools

Databricks

Delta Lake

MLflow

AWS

Azure

GCP

Job description

ECS Corporate Services in Arlington, VA is seeking a Sr. Databricks Consultant to design, optimize, and fine-tune Databricks environments for advanced analytics, ML, and AI-driven insights.

You will lead data pipeline optimization, scalable model training, and collaborate with clients to deliver measurable improvements using Delta Lake, MLflow, and Databricks ML. This role includes security/compliance focus and requires US citizenship per contract.