Lead Data Engineer — Databricks & Azure Data Factory

Bitwise; Richmond (VA); On-site; USD 150,000 - 190,000; Full time

Job summary

Bitwise in Richmond, VA is seeking a Lead Data Engineer with 8-10 years of experience to lead data pipelines using Databricks and Azure Data Factory. You will architect scalable data solutions and mentor a growing engineering team.

You will collaborate with customers, drive technical discussions, ensure data quality and governance with Delta Lake and Unity Catalog, and steer agile delivery across projects.

Qualifications

• 8-10 years of experience as Lead Data Engineer, with focus on Databricks and Azure Data Factory.
• Proven ability to lead data engineering teams, drive technical approaches and customer conversations.
• Strong SQL, data warehousing concepts, data modeling and data quality.
• Experience with Agile development and working independently or in a team.
• Experience with Talend or Informatica is a plus.

Responsibilities

• Lead data engineering teams on Databricks and ADF initiatives.
• Design, develop, and deploy ETL pipelines and notebooks.
• Collaborate with customers to drive technical solutions and architecture.
• Establish data governance and quality controls with Delta Lake and Unity Catalog.
• Mentor teammates and drive continuous value additions and innovations.

Skills

Databricks

Azure Data Factory

SQL

Data modeling

Data quality

Agile

Team leadership

Communication

ETL pipelines

Gen AI concepts

Tools

Databricks

Azure Data Factory

Delta Lake

Unity Catalog

Parquet

Delta files

Azure Blob Storage

ADLS

Synapse

Talend

Informatica

Job description

Bitwise in Richmond, VA is seeking a Lead Data Engineer with 8-10 years of experience to lead data pipelines using Databricks and Azure Data Factory. You will architect scalable data solutions and mentor a growing engineering team.

You will collaborate with customers, drive technical discussions, ensure data quality and governance with Delta Lake and Unity Catalog, and steer agile delivery across projects.