Databricks & AI Data Architect

International Business Machines Corporation; Minneapolis (MN); Remote; USD 150,000 - 185,000; Full time

Job summary

IBM Consulting seeks a senior data/AI architecture leader to guide enterprise-scale data, AI/GenAI initiatives across cloud platforms. You will shape data platforms, governance, and scalable patterns aligning with business goals and security controls.

You will drive cross-cloud design, data product concepts, and a pipeline from ingestion to analytics, ensuring reliable, cost-conscious, and compliant architectures across AWS, Azure, and GCP.

Qualifications

• Databricks certified or equivalent with enterprise-scale data, AI/ML, GenAI experience.
• Advanced data/solution architecture and lakehouse/data-product modeling.
• Hands-on Spark, Delta Lake, MLflow, Unity Catalog, large-scale workloads.
• Experience with open table formats (Delta Lake, Apache Iceberg) and data sharing.
• Experience architecting GenAI solutions including RAG, MLOps/LLMOps, governance.

Responsibilities

• Define target data and AI architecture across AWS/Databricks/ GCP, and integration patterns.
• Lead data migration architecture, sequencing, cutover, and risk management.
• Own data architecture and data modeling standards across lakehouse layers.
• Define data engineering patterns for ingestion, transformation, and CI/CD.
• Architect the reporting layer with semantic models and governance.
• Design ML/GenAI lifecycle, monitoring, and MLOps/LLMOps.

Skills

Databricks Certification

Enterprise data architecture

Data migration planning

Lakehouse architecture

CI/CD patterns

Security governance

Executive communication

APIs & microservices

Tools

Spark

Delta Lake

MLflow

Unity Catalog

Apache Iceberg

Kafka

EventBridge

Job description

IBM Consulting seeks a senior data/AI architecture leader to guide enterprise-scale data, AI/GenAI initiatives across cloud platforms. You will shape data platforms, governance, and scalable patterns aligning with business goals and security controls.

You will drive cross-cloud design, data product concepts, and a pipeline from ingestion to analytics, ensuring reliable, cost-conscious, and compliant architectures across AWS, Azure, and GCP.