Sr. Databricks Consultant - DHS Public Trust

ECS Corporate Services; Fairfax (VA); Hybrid; USD 175,000 - 250,000; Full time

Job summary

ECS Corporate Services is seeking a Sr. Databricks Consultant to design and optimize advanced Databricks environments for analytics, ML, and AI insights. You will collaborate with clients to deliver scalable data pipelines and secure, compliant data platforms.

The role emphasizes production Databricks experience, cloud integrations, and strong Python/SQL skills to drive measurable improvements in data-driven decision-making.

Qualifications

• Active DHS Public Trust Clearance is required.
• Proven experience with Databricks in production environments.
• Bachelor's degree preferred, or equivalent work experience.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Databricks

Python

SQL

Apache Spark

Data modeling

Data quality

Performance tuning

CI/CD

Git

Data governance

Education

Bachelor's degree preferred in CS or related field

Will consider experience in lieu of degree

Tools

Cloud platforms (AWS/Azure/GCP)

Databricks (production)

Job description

Sr. Databricks Consultant

Location: Arlington, VA office/remotely.

Please Note: This position is contingent upon additional funding.

We are seeking a skilled individual with deep experience in Databricks to join our team. The primary responsibility of this role is to consult with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, machine learning, and AI-driven insights. Leveraging tools such as Delta Lake, MLflow, and Databricks Machine Learning, the Data Scientist will play a crucial role in enabling clients to maximize performance, scalability, and value from their data platforms. This role will support ECS's Professional Services and Managed Cybersecurity Services programs, with a focus on Databricks solutions. You will specialize in data pipeline optimization, scalable model training, and advanced analytics on Databricks, offering you a unique opportunity to work with leading-edge technologies and collaborate with clients to deliver measurable improvements in data-driven decision-making.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Salary Range: $175,000 - $250,000

Benefits and Requirements

• Active DHS Public Trust Clearance
• Proven experience working with Databricks in production environments.
• Strong proficiency in Python and/or SQL for data engineering.
• Experience with Apache Spark for distributed data processing.
• Knowledge of data lakehouse architecture and best practices.
• Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
• Hands-on experience building and managing ETL/ELT pipelines.
• Strong understanding of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD pipelines and version control (Git).
• Ability to travel, as needed, to customer sites.
• Must be a US Citizen per contract.
• Bachelor's degree; preferably in Computer Science, Information Security, or a related field.
• Will consider experience in lieu of a degree.