Databricks & AI Data Architect - Hybrid Cloud

International Business Machines Corporation; Houston (TX); Remote; USD 170,000 - 230,000; Full time

Job summary

IBM Consulting is seeking a Databricks Solution Architect to lead end-to-end data modernization architecture for large-scale AI initiatives. You will design cloud-based data platforms, data models, governance, and secure cross-cloud integration across AWS, Azure, and GCP, tying in SAP data into Databricks.

The role requires deep expertise in data engineering, GenAI, and MLOps, with a focus on scalable, policy-compliant designs and strong executive communication.

Qualifications

• Databricks Certified/Data Engineer or ML Professional preferred.
• Enterprise-scale data, AI/ML and GenAI solutions architecture experience.
• Advanced data/solution architecture, migration, lakehouse/data-product design.

Responsibilities

• Define target data/AI architecture across cloud platforms and integration patterns.
• Lead data migration architecture including patterns, sequencing, cutover and risk management.
• Own data modeling standards, lakehouse layers, and data product design.
• Define data engineering patterns for ingestion, transformation, orchestration, and cost control.
• Architect reporting/analytics with semantic models and governed metrics.
• Design the ML/GenAI lifecycle with MLOps/LLMOps, monitoring and evaluation.
• Architect secure, cross-cloud data movement across AWS/Azure/GCP with governance.
• Integrate SAP data via SAP BTP/BDC Connect into Databricks lakehouse.
• Define security, privacy and responsible AI guardrails from design to operations.
• Provide architecture oversight on initiatives like MySQL to Databricks Lakebase migrations.

Skills

Databricks

Data architecture

Cloud platforms

Spark

Delta Lake

MLOps

GenAI

RAG

Governance

APIs

Tools

Fivetran

Unity Catalog

Delta Sharing

Kafka

Apache Iceberg

EventBridge

Job description

IBM Consulting is seeking a Databricks Solution Architect to lead end-to-end data modernization architecture for large-scale AI initiatives. You will design cloud-based data platforms, data models, governance, and secure cross-cloud integration across AWS, Azure, and GCP, tying in SAP data into Databricks.

The role requires deep expertise in data engineering, GenAI, and MLOps, with a focus on scalable, policy-compliant designs and strong executive communication.