Senior Databricks Architect for AI-Driven Data Platforms

West Monroe; Los Angeles (CA); Hybrid; USD 205,000 - 234,000; Full time

Benefits offered by this job

Medical, dental, vision

401k plan

Employee stock ownership program

Unlimited PTO

10 holidays

Parental leave

Job summary

West Monroe is seeking a Senior Architect to join its Technology and Experience Practice in a hybrid role in the Los Angeles area. You will design data pipelines and architectures for big data, steer AI/ML initiatives, and guide modernization efforts across healthcare, financial services, insurance, and utilities clients.

The role emphasizes Databricks mastery, data governance, and secure, scalable cloud data engineering. Travel up to 30–50% and leadership of consulting teams are expected.

Qualifications

• Over a decade of professional experience with a focus on Databricks and data engineering.
• Experience designing enterprise AI/ML or Generative AI solutions.
• Proven ability to lead consulting engagements and coach teams.

Responsibilities

• Design data flows and pipelines using Spark/Scala, Storm, Flume, Sqoop.
• Lead data architecture, governance, and platform selection for clients.
• Collaborate with data science to productionize ML/Generative AI workloads.
• Establish AI data readiness, feature engineering, and model observability.
• Guide AI modernization strategies including semantic layers and vector databases.
• Evaluate AI tooling and ensure security/compliance.
• Perform code reviews and share best practices with consultants.
• Coordinate with data owners to integrate analytics platforms.
• Address data integrity issues and liaise with stakeholders.

Skills

Databricks

Spark/Scala

AI/ML

LLM ecosystems

Cloud data engineering

Data governance

Data architecture

Security/compliance

Leadership

Client consulting

Team coaching

Tools

Delta Lake

Unity Catalog

Workflow orchestration

Databricks Mosaic AI

OpenAI

Azure OpenAI

LangChain

MLflow

Vector databases

Job description

West Monroe is seeking a Senior Architect to join its Technology and Experience Practice in a hybrid role in the Los Angeles area. You will design data pipelines and architectures for big data, steer AI/ML initiatives, and guide modernization efforts across healthcare, financial services, insurance, and utilities clients.

The role emphasizes Databricks mastery, data governance, and secure, scalable cloud data engineering. Travel up to 30–50% and leadership of consulting teams are expected.