Databricks Platform Architect for Data Pipelines & ML

ECS Corporate Services; Fairfax (VA); On-site; USD 175,000 - 250,000; Full time

Benefits offered by this job

TS/SCI-CI Poly Clearance

Job summary

ECS Corporate Services is seeking a Sr. Databricks Consultant to design, optimize, and fine-tune Databricks environments for advanced analytics.

You will collaborate with clients to enable data-driven decisions and deliver measurable improvements in performance and scalability. Responsibilities include building ETL/ELT pipelines, optimizing clusters, and integrating Databricks with cloud platforms while upholding governance and security requirements.

Qualifications

• Experience designing and optimizing Databricks environments.
• Strong Python/SQL for data engineering.
• Familiarity with Spark and data lakehouse architectures.
• Experience with cloud data platforms (AWS/Azure/GCP).
• Bachelor's degree or equivalent experience.

Responsibilities

• Design, build, and maintain scalable ETL/ELT pipelines in Databricks.
• Optimize workflows and clusters for performance and cost efficiency.
• Integrate Databricks with cloud platforms (AWS, Azure, or GCP).
• Implement data governance, security, and compliance standards.
• Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality datasets and insights.
• Troubleshoot issues and drive continuous improvement in data infrastructure.

Skills

Python/SQL

Apache Spark

Data Lakehouse

Cloud Platforms (AWS/Azure/GCP)

ETL/ELT Pipelines

Data Modeling

Data Quality

Performance Tuning

Git & CI/CD

Willingness to Travel

Education

Bachelor's degree in CS/Information Security or related field

Experience in lieu of degree considered

Tools

Databricks

Git

CI/CD tooling

Job description

ECS Corporate Services is seeking a Sr. Databricks Consultant to design, optimize, and fine-tune Databricks environments for advanced analytics.

You will collaborate with clients to enable data-driven decisions and deliver measurable improvements in performance and scalability. Responsibilities include building ETL/ELT pipelines, optimizing clusters, and integrating Databricks with cloud platforms while upholding governance and security requirements.