Remote Senior Databricks Consultant – Data Platform Optimization

ECS; Virginia (MN); Hybrid; USD 175,000 - 250,000; Full time

Job summary

ECS is seeking a Sr. Databricks Consultant to consult with customers and design, optimize, and fine-tune their Databricks environments for advanced analytics, ML, and AI-driven insights.

This role supports ECS’s Professional Services and Managed Cybersecurity Services programs in the Arlington, VA area, with remote options. The ideal candidate has deep Databricks experience, strong Python/SQL skills, and a track record of enabling scalable, cost-efficient data platforms.

Qualifications

• Experience with Databricks in production environments.
• Proficiency in Python and/or SQL for data engineering.
• Strong knowledge of Spark for distributed data processing.
• Experience with cloud data platforms (AWS S3, Azure Data Lake, GCP Storage).
• Understanding of data lakehouse architecture and best practices.
• Hands-on experience building and managing ETL/ELT pipelines.
• Knowledge of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD pipelines and Git version control.
• Willingness to travel and US citizenship required.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and stakeholders to deliver datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Python

SQL

Data engineering

Databricks

Apache Spark

GIT

US Citizenship

DHS Public Trust

Education

Bachelor's degree

Tools

Databricks

Delta Lake

MLflow

Job description

ECS is seeking a Sr. Databricks Consultant to consult with customers and design, optimize, and fine-tune their Databricks environments for advanced analytics, ML, and AI-driven insights.

This role supports ECS’s Professional Services and Managed Cybersecurity Services programs in the Arlington, VA area, with remote options. The ideal candidate has deep Databricks experience, strong Python/SQL skills, and a track record of enabling scalable, cost-efficient data platforms.