Databricks Lakehouse Architect for Scalable Data Platform

Bloomberg Industry Group; Arlington (VA); On-site; USD 180,000 - 220,000; Full time

Job summary

Bloomberg Industry Group is seeking a data engineer to join a highly collaborative team, partnering with product analytics, and engineering to deliver trusted data across a modern cloud platform.

You will drive scalable data systems, evolve a Databricks-based Lakehouse, and translate complex product behavior into reliable datasets powering analytics and experimentation. Strong leadership and architecture skills are required.

Qualifications

• Strong experience building and operating data pipelines using SQL and Python in a modern cloud environment.
• Deep expertise in SQL, including complex transformations, data modeling, query optimization, and performance tuning at scale.
• 10+ years of experience in data engineering, data architecture, or related fields, with production data systems ownership.
• Proven ability to design data models for analytics and to translate business requirements into reliable datasets.

Responsibilities

• Partner with product analytics stakeholders to translate KPIs into scalable, production-grade datasets.
• Own design, build, and operation of scalable data pipelines end-to-end.
• Define and evolve the Product Analytics Lakehouse architecture to improve scalability, performance, and governance.
• Build and maintain production-grade, well-modeled datasets powering analytics and AI use cases.
• Lead adoption of reusable data engineering patterns, standards, and guardrails.
• Own data quality and reliability for production datasets, including monitoring and SLAs.
• Productionize and scale prototypes into reliable data pipelines.
• Develop governed datasets to support AI/ML use cases with controlled data access.

Skills

Collaborative data engineering

Architectural design

Mentoring

Technical leadership

Education

Bachelor's degree in computer science or related discipline

Master's degree preferred

Tools

Databricks

Spark/PySpark

CI/CD

Job description

Bloomberg Industry Group is seeking a data engineer to join a highly collaborative team, partnering with product analytics, and engineering to deliver trusted data across a modern cloud platform.

You will drive scalable data systems, evolve a Databricks-based Lakehouse, and translate complex product behavior into reliable datasets powering analytics and experimentation. Strong leadership and architecture skills are required.