Hybrid Data Engineering Lead: Databricks & ADF

Bitwise; Richmond (VA); Hybrid; USD 140,000 - 180,000; Full time

Job summary

Bitwise is seeking a Data Engineer Lead to drive a Richmond, VA data platform initiative. You will design scalable data pipelines, mentor engineers, and collaborate with customers to deliver robust, cloud-based data solutions using Databricks and Azure Data Factory.

The role emphasizes hands-on Databricks development, Delta Lake governance, and Azure data integration, while promoting best practices, performance, and cost optimization in an Agile environment.

Qualifications

• 8-10 years of experience as a Lead Data Engineer with a strong focus on Databricks & Azure Data Factory.

Responsibilities

• Design, develop, and deploy data pipelines using Databricks, including data ingestion, transformation, and loading (ETL) processes.
• Lead team and drive through technical challenges and solutions. Drive technical calls with customer
• Troubleshoot and resolve data pipeline issues effectively.

Skills

Lead team leadership

Communication

Agile development

Independent worker

Data modeling

Data quality

SQL proficiency

Innovation mindset

Tools

Databricks

Azure Data Factory

Azure Synapse

Delta Lake

Unity Catalog

Parquet

Delta files

Azure Blob Storage

ADLS

Azure Storage Explorer

Azure DevOps

Job description

Bitwise is seeking a Data Engineer Lead to drive a Richmond, VA data platform initiative. You will design scalable data pipelines, mentor engineers, and collaborate with customers to deliver robust, cloud-based data solutions using Databricks and Azure Data Factory.

The role emphasizes hands-on Databricks development, Delta Lake governance, and Azure data integration, while promoting best practices, performance, and cost optimization in an Agile environment.