Databricks Lakehouse Architect

Bloomberg BNA; Arlington (VA); On-site; USD 180,000 - 220,000; Full time

Job summary

Bloomberg Industry Group is seeking an experienced Data Engineer to lead end-to-end data pipelines in a Databricks Lakehouse, translating product analytics needs into scalable, governed datasets.

You will design future-state architectures, drive data quality, and mentor engineers while collaborating with analytics and product teams to power analytics, experimentation, and decision-making.

Qualifications

• Bachelor's degree in computer science or related discipline or equivalent experience.
• 10+ years of experience in data engineering or data architecture.
• Hands-on production experience with Databricks in cloud environments.
• Experience designing scalable data pipelines and governance patterns.
• Ability to translate business needs into reliable data products.

Responsibilities

• Own end-to-end data pipelines from ingestion to serving in a Databricks Lakehouse.
• Define and evolve data architectures, models, and production patterns.
• Lead data quality, monitoring, SLAs, and incident resolution for datasets.
• Collaborate with product analytics to translate KPIs into datasets.
• Mentor engineers and drive adoption of reusable data frameworks.

Skills

SQL

Python

Databricks

Spark

Data modeling

Data governance

Architectural design

Stakeholder collaboration

CI/CD

Education

Bachelor's degree in Computer Science or related

Master's degree preferred

Tools

Databricks

Spark/PySpark

SQL engines

Job description

Bloomberg Industry Group is seeking an experienced Data Engineer to lead end-to-end data pipelines in a Databricks Lakehouse, translating product analytics needs into scalable, governed datasets.

You will design future-state architectures, drive data quality, and mentor engineers while collaborating with analytics and product teams to power analytics, experimentation, and decision-making.