Sr. Databricks Consultant

ECS Corporate Services; Fairfax (VA); Hybrid; USD 175,000 - 250,000; Full time

Job summary

ECS Corporate Services is seeking a Sr. Databricks Consultant to join our Arlington, VA office with optional remote work.

You will design, optimize, and fine-tune Databricks environments for advanced analytics, ML, and AI-driven insights, collaborating with clients to maximize performance and value from data platforms. You will lead ETL/ELT pipelines, integrate with cloud platforms, and implement governance and security standards while partnering with data scientists and stakeholders to deliver

Qualifications

• Proven experience with Databricks in production environments.
• Strong proficiency in Python and SQL for data engineering.
• Experience with Apache Spark for distributed processing.
• Knowledge of data lakehouse architectures and best practices.
• Experience with cloud data platforms (AWS, Azure, or GCP).
• Hands-on experience building and managing ETL/ELT pipelines.
• Strong understanding of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD pipelines and Git.
• Ability to travel to customer sites as needed.
• Must be a US Citizen per contract.
• Bachelor's degree; preferably in Computer Science, Information Security, or related field.
• Will consider experience in lieu of a degree.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Python

SQL

Apache Spark

Data modeling

CI/CD

Git

Data governance

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Delta Lake

MLflow

AWS S3

Azure Data Lake

GCP Storage

Job description

ECS is seeking a Sr. Databricks Consultant to work in our Arlington, VA office/remotely. Please Note: This position is contingent upon additional funding. We are seeking a skilled individual with deep experience in Databricks to join our team. The primary responsibility of this role is to consult with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, machine learning, and AI-driven insights. Leveraging tools such as Delta Lake, MLflow, and Databricks Machine Learning, the Data Scientist will play a crucial role in enabling clients to maximize performance, scalability, and value from their data platforms. This role will support ECS's Professional Services and Managed Cybersecurity Services programs, with a focus on Databricks solutions. You will specialize in data pipeline optimization, scalable model training, and advanced analytics on Databricks, offering you a unique opportunity to work with leading-edge technologies and collaborate with clients to deliver measurable improvements in data-driven decision-making. If you are passionate about applying data science techniques within the Databricks ecosystem to solve real-world challenges, we encourage you to apply.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Salary Range: $175,000 - $250,000

General Description of Benefits

• Proven experience working with Databricks in production environments.
• Strong proficiency in Python and/or SQL for data engineering.
• Experience with Apache Spark for distributed data processing.
• Knowledge of data lakehouse architecture and best practices.
• Experience with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
• Hands-on experience building and managing ETL/ELT pipelines.
• Strong understanding of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD pipelines and version control (Git).
• Ability to travel, as needed, to customer sites.
• Must be a US Citizen per contract.
• Bachelor's degree; preferably in Computer Science, Information Security, or a related field.
• Will consider experience in lieu of a degree.