Sr. Databricks Consultant

ECS; Richmond (VA); Hybrid; USD 175,000 - 250,000; Full time

Job summary

ECS Federal LLC in the Arlington, VA area is seeking a Sr. Databricks Consultant to join our team, with remote work options.

This role consults with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, ML, and AI-driven insights. You will work with Delta Lake, MLflow, and Databricks Machine Learning to maximize performance, scalability, and value from data platforms, collaborating with data scientists, analysts, and stakeholders to deliver

Qualifications

• Must have proven Databricks production experience.
• Strong Python/SQL for data engineering.
• Experience with Apache Spark for distributed processing.
• Knowledge of data lakehouse architectures and governance.
• Experience integrating with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
• Hands-on ETL/ELT pipeline development.
• Understanding of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD and Git workflows.
• Ability to travel to customer sites as needed.
• U.S. citizenship is required by contract.
• Bachelor’s degree in CS, IS, or related field (or equivalent experience).

Responsibilities

• Design, build, and maintain scalable Databricks ETL/ELT pipelines.
• Optimize workflows and clusters for cost and performance.
• Integrate Databricks with AWS, Azure, or GCP.
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and stakeholders to deliver high-quality datasets.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Databricks production

Python/SQL

Apache Spark

Data lakehouse

Cloud platforms AWS/Azure/GCP

ETL/ELT pipelines

Data modeling

Data quality

Performance tuning

CI/CD Git

Travel readiness

US citizenship

Education

Bachelor's degree in CS/IS or related

Tools

Git

Terraform

CloudFormation

Unity Catalog

Kafka/Kinesis/Event Hubs

Job description

Job Description

ECS is seeking a

This position is contingent upon additional funding.

We are seeking a skilled individual with deep experience in Databricks to join our team. The primary responsibility of this role is to consult with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, machine learning, and AI-driven insights. Leveraging tools such as Delta Lake, MLflow, and Databricks Machine Learning, the Data Scientist will play a crucial role in enabling clients to maximize performance, scalability, and value from their data platforms.

Job Description

ECS is seeking a Sr. Databricks Consultant to work in our Arlington, VA office/remotely. Please Note: This position is contingent upon additional funding.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Salary Range: $175,000 - $250,000

General Description Of Benefits

Required Skills

• Proven experience working with Databricks in production environments.
• Strong proficiency in Python and/or SQL for data engineering.
• Experience with Apache Spark for distributed data processing.
• Knowledge of data lakehouse architecture and best practices.
• Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
• Hands‑on experience building and managing ETL/ELT pipelines.
• Strong understanding of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD pipelines and version control (Git).
• Ability to travel, as needed, to customer sites.
• Must be a US Citizen per contract.
• Bachelor’s degree; preferably in Computer Science, Information Security, or a related field. Will consider experience in lieu of a degree.

Desired Skills

• Master's degree or PhD in Computer Science, Data Science, or a related field
• Experience with machine learning pipelines in Databricks (MLflow).
• Knowledge of Delta Lake and Unity Catalog for governance.
• Familiarity with streaming technologies (Kafka, Kinesis, or Event Hubs).
• Exposure to data visualization tools (Tableau, Power BI, or Looker).
• Experience with Terraform, ARM, or CloudFormation for infrastructure as code.
• Background in data security and compliance (HIPAA, FedRAMP, SOC2, etc.).
• Strong understanding of DevOps/MLOps practices.
• Prior consulting or customer‑facing experience
• Skills in project management and familiarity with methodologies like Agile can be beneficial, particularly in managed service environments.

ECS Federal LLC is an equal opportunity employer and does not discriminate or allow discrimination on the basis any characteristic protected by law. All qualified applicants will receive consideration for employment without regard to disability, status as a protected veteran or any other status protected by applicable federal, state, or local jurisdiction law.

Everforth ECS is the federal segment of Everforth, a $4B global organization with over 10,000 employees. Our nearly 3,500 professionals deliver advanced technology solutions in data and AI, cybersecurity, and enterprise transformation, serving defense, intelligence, and federal civilian agencies. Our work powers mission‑critical outcomes, strengthens technology partnerships, and creates meaningful opportunities for our people. We are defined by a commitment to excellence in delivery, a culture of innovation, and an environment where talent can thrive and grow.

We Value

• Attracting and developing top talent and high‑performing teams
• Fostering a culture that is engaging, accountable, and mission‑driven

Meet the challenge. Make a difference with Everforth ECS!