Azure Databricks Data Architect: Lakehouse & Governance

Pillsbury Winthrop Shaw Pittman LLP; Nashville (TN); On-site; USD 200,000 - 230,000; Full time

Job summary

Pillsbury Winthrop Shaw Pittman LLP is seeking a Data Architect to design and evolve the firm’s enterprise data foundation. You will work on Azure Databricks lakehouse, data models, and governance, partnering with AI, security, and business teams to deliver secure, traceable data for analytics and AI workflows.

The role emphasizes scalable pipelines, data contracts, and robust data quality controls, with a focus on enterprise data integration and compliant access management.

Qualifications

• Bachelor's degree in a technical field or equivalent experience.
• Significant experience designing, implementing, and operating enterprise data architectures.
• Advanced hands-on experience with Azure Databricks, Spark, Delta Lake, and Unity Catalog.
• Proficiency in SQL and Python with production data pipelines.

Responsibilities

• Lead design and evolution of Azure Databricks data architecture and lakehouse layers.
• Identify priority data requirements and establish data quality standards.
• Model enterprise data including client, matter, and financial data.
• Build scalable data ingestion and transformation pipelines with Python, SQL, Spark, and Delta Lake.
• Define source-to-target mappings and data contracts; manage schema changes.
• Govern data within Unity Catalog including catalogs, schemas, and access policies.
• Collaborate with security to design appropriate access controls and confidentiality measures.
• Ensure data quality, monitoring, and reliable performance of pipelines.
• Develop curated datasets and data interfaces for analytics and AI workflows.

Skills

Azure Databricks

Data architecture

Unity Catalog

SQL

Python

Delta Lake

PySpark

Data governance

Data modeling

ETL pipelines

PostgreSQL

Education

Bachelor's degree in a technical field

Master's degree (preferred)

Tools

Azure Databricks

Unity Catalog

Delta Lake

PySpark

PostgreSQL

Terraform

Azure DevOps

GitHub Actions

Spark

SQL

Python

Job description

Pillsbury Winthrop Shaw Pittman LLP is seeking a Data Architect to design and evolve the firm’s enterprise data foundation. You will work on Azure Databricks lakehouse, data models, and governance, partnering with AI, security, and business teams to deliver secure, traceable data for analytics and AI workflows.

The role emphasizes scalable pipelines, data contracts, and robust data quality controls, with a focus on enterprise data integration and compliant access management.