Senior Cloud Data Architect: AI-Driven Data Mesh & RAG

The Judge Group; Huntington Park (CA); On-site; USD 170,000 - 175,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

Retirement savings plan with company 2

Paid time off and holidays

Job summary

The Judge Group is seeking a Cloud Data Architect to lead the modernization of enterprise data platforms from on-prem to cloud for banking and insurance clients. The role requires designing scalable solutions using Snowflake and Databricks on AWS and Azure, and shaping data governance, quality, and security frameworks.

You will architect AI and Gen AI solutions across the data value chain, leverage LLMs and vector databases, and drive standardized patterns and memory-aware retrieval pipelines

Qualifications

• Architect enterprise data platforms for data lake, Lakehouse and streaming systems.
• Design data integration and data pipeline patterns.
• Evaluate new technologies and run proof of concepts.
• Set data and AI strategy for data organization.
• Establish data quality, lineage and metadata standards.
• Ensure privacy, security and regulatory compliance.
• Drive adoption of responsible AI frameworks.
• Create architectural guardrails and reusable patterns.
• Lead standards across data organizations.
• Review designs and elevate architectural thinking.

Responsibilities

• Lead enterprise data platform modernization from on-prem to cloud for banking and insurance clients.
• Architect and implement scalable solutions using Snowflake and Databricks on AWS and Azure.
• Design data integration pipelines (batch, real-time, big data) and analytics platforms.
• Define and implement governance, quality, metadata and lineage frameworks including GenAI capabilities.
• Advise senior business and IT stakeholders, architect AI ecosystems with LLMs, vector DBs and orchestration.
• Define MCPs to chain reasoning, retrieval and actions; design A2A communication protocols and RAG pipelines.

Skills

Data architecture

Data governance

AI strategy

LLMs

Prompt engineering

LangChain

AutoGen

CrewAI

RAG pipelines

Vector databases

MLOps

Python

Cloud platforms

Snowflake

Databricks

AWS

Azure

GCP

FAISS

Pinecone

Weaviate

ML models & frameworks

Data mesh

Medallion Architecture

Security & privacy

ReAct

Tree of Thought

AutoGPT

Tools

Snowflake

Databricks

AWS

Azure

GCP

LangChain

AutoGen

CrewAI

OpenAI APIs

Anthropic Claude

FAISS

Pinecone

Weaviate

Job description

The Judge Group is seeking a Cloud Data Architect to lead the modernization of enterprise data platforms from on-prem to cloud for banking and insurance clients. The role requires designing scalable solutions using Snowflake and Databricks on AWS and Azure, and shaping data governance, quality, and security frameworks.

You will architect AI and Gen AI solutions across the data value chain, leverage LLMs and vector databases, and drive standardized patterns and memory-aware retrieval pipelines