Senior Databricks Architect — Data Pipelines & ML (Remote)

ECS Corporate Services; Fairfax (VA); Hybrid; USD 175,000 - 250,000; Full time

Job summary

ECS Corporate Services is seeking a Sr. Databricks Consultant to join our Arlington, VA office with optional remote work.

You will design, optimize, and fine-tune Databricks environments for advanced analytics, ML, and AI-driven insights, collaborating with clients to maximize performance and value from data platforms. You will lead ETL/ELT pipelines, integrate with cloud platforms, and implement governance and security standards while partnering with data scientists and stakeholders to deliver

Qualifications

• Proven experience with Databricks in production environments.
• Strong proficiency in Python and SQL for data engineering.
• Experience with Apache Spark for distributed processing.
• Knowledge of data lakehouse architectures and best practices.
• Experience with cloud data platforms (AWS, Azure, or GCP).
• Hands-on experience building and managing ETL/ELT pipelines.
• Strong understanding of data modeling, data quality, and performance tuning.
• Familiarity with CI/CD pipelines and Git.
• Ability to travel to customer sites as needed.
• Must be a US Citizen per contract.
• Bachelor's degree; preferably in Computer Science, Information Security, or related field.
• Will consider experience in lieu of a degree.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Python

SQL

Apache Spark

Data modeling

CI/CD

Git

Data governance

Education

Bachelor's degree in Computer Science or related field

Tools

Databricks

Delta Lake

MLflow

AWS S3

Azure Data Lake

GCP Storage

Job description

ECS Corporate Services is seeking a Sr. Databricks Consultant to join our Arlington, VA office with optional remote work.

You will design, optimize, and fine-tune Databricks environments for advanced analytics, ML, and AI-driven insights, collaborating with clients to maximize performance and value from data platforms. You will lead ETL/ELT pipelines, integrate with cloud platforms, and implement governance and security standards while partnering with data scientists and stakeholders to deliver