Enterprise Databricks & AI Solution Architect

International Business Machines Corporation; Dallas (TX); Remoto; USD 150.000 - 210.000; Tempo pieno

Descrizione del lavoro

IBM Consulting seeks a Databricks Solution Architect to lead enterprise data modernization across AWS, Databricks, and GCP. You will define end-to-end architectures, govern data products, and connect AI/GenAI capabilities to business workflows.

Responsibilities include data modeling, migration leadership, security governance, and cross-cloud integration, with frequent executive communication. The role can be performed from anywhere in the US, requiring travel.

Competenze

• Databricks Certified Data Engineer or Machine Learning Professional with enterprise-scale data/AI experience.
• Expertise in data/solution architecture, migration, lakehouse/data-product architecture, reporting, and cloud data engineering using Databricks and AWS.
• Hands-on with Spark (PySpark/Scala), Delta Lake, MLflow, Unity Catalog, and large-scale workloads.

Mansioni

• Define the target data and AI architecture across AWS/Databricks and GCP services, plus integration patterns.
• Lead data migration architecture with re-engineering, patterns, ingestion, sequencing, cutover, and risk management.
• Own data architecture and modeling standards including lakehouse layers and data product design.
• Define data engineering patterns for ingestion, transformation, orchestration, CI/CD, observability, and cost control.
• Architect the reporting/analytics layer with semantic models and governed metrics.
• Design the ML/GenAI lifecycle including feature engineering, model training/serving, MLOps/LLMOps, monitoring.
• Architect secure cross-cloud data movement across hyperscalers and governed AI guardrails.
• Provide architectural oversight on initiatives like MySQL to Databricks Lakebase migrations.
• Collaborate with stakeholders to translate business objectives into scalable, policy-compliant designs.

Conoscenze

Databricks platform

Data architecture

Data migration

Data modeling

Lakehouse

ML/GenAI

Cloud engineering

Spark PySpark

Delta Lake

Governance

APIs & microservices

Security

Executive communication

Strumenti

Fivetran

Databricks Lakebase

Collibra

Erwin

ER Studio

Apache Iceberg

Kafka

Amazon EventBridge

Descrizione del lavoro

IBM Consulting seeks a Databricks Solution Architect to lead enterprise data modernization across AWS, Databricks, and GCP. You will define end-to-end architectures, govern data products, and connect AI/GenAI capabilities to business workflows.

Responsibilities include data modeling, migration leadership, security governance, and cross-cloud integration, with frequent executive communication. The role can be performed from anywhere in the US, requiring travel.