Remote Senior Databricks Consultant - Data Platform Architect

ECS; Richmond (VA); Hybrid; USD 175,000 - 250,000; Full time

Job summary

ECS Federal LLC in the Arlington, VA area is seeking a Sr. Databricks Consultant to join our team, with remote work options.

This role consults with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, ML, and AI-driven insights. You will work with Delta Lake, MLflow, and Databricks Machine Learning to maximize performance, scalability, and value from data platforms, collaborating with data scientists, analysts, and stakeholders to deliver

Qualifications

• Must have proven Databricks production experience.
• Strong Python/SQL for data engineering.
• Experience with Apache Spark for distributed processing.
• Knowledge of data lakehouse architectures and governance.
• Experience integrating with cloud data platforms (AWS S3, Azure Data Lake, or GCP Storage).
• Hands-on ETL/ELT pipeline development.
• Understanding of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD and Git workflows.
• Ability to travel to customer sites as needed.
• U.S. citizenship is required by contract.
• Bachelor’s degree in CS, IS, or related field (or equivalent experience).

Responsibilities

• Design, build, and maintain scalable Databricks ETL/ELT pipelines.
• Optimize workflows and clusters for cost and performance.
• Integrate Databricks with AWS, Azure, or GCP.
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and stakeholders to deliver high-quality datasets.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Databricks production

Python/SQL

Apache Spark

Data lakehouse

Cloud platforms AWS/Azure/GCP

ETL/ELT pipelines

Data modeling

Data quality

Performance tuning

CI/CD Git

Travel readiness

US citizenship

Education

Bachelor's degree in CS/IS or related

Tools

Git

Terraform

CloudFormation

Unity Catalog

Kafka/Kinesis/Event Hubs

Job description

ECS Federal LLC in the Arlington, VA area is seeking a Sr. Databricks Consultant to join our team, with remote work options.

This role consults with customers to design, optimize, and fine-tune their Databricks environments for advanced data analytics, ML, and AI-driven insights. You will work with Delta Lake, MLflow, and Databricks Machine Learning to maximize performance, scalability, and value from data platforms, collaborating with data scientists, analysts, and stakeholders to deliver