Senior Data Architect (with Generative AI) (Fully Remote)

Unknown; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

Unknown is seeking an experienced data engineering/architecture leader to design and implement enterprise data architectures for both batch and real-time processing.

You will build AI-ready data pipelines, RAG infrastructure, and vector search using Generative AI tech, leveraging Treasure Data CDP, Kafka, Snowflake/Databricks, and cloud platforms for production-grade solutions.

Qualifications

• 10+ years in data engineering/architecture with strong ETL/ELT, Python, and SQL.
• Hands-on Treasure Data CDP and enterprise data warehouse/lakehouse experience.
• Real-time analytics, event-driven architecture, streaming pipelines, and Apache Kafka.
• Experience with CDC/Debezium and incremental processing is preferred.
• Generative AI data engineering with LangChain, LangGraph, AI Agents, Azure OpenAI, AWS Bedrock.

Responsibilities

• Design and implement enterprise data architectures for batch and real-time processing.
• Build AI-ready data pipelines, RAG infrastructure, and vector search using Generative AI technologies.
• Leverage Treasure Data CDP, Kafka, Snowflake/Databricks, and cloud platforms to deliver production-grade solutions.

Skills

ETL/ELT

Python

SQL

Real-time analytics

Event-driven architecture

Kafka

Cloud platforms

Generative AI data engineering

LangChain

LangGraph

Azure OpenAI

AWS Bedrock

Treasure Data CDP

Snowflake

Databricks

Tools

Treasure Data CDP

Kafka

Snowflake

Databricks

LangChain

LangGraph

Azure OpenAI

AWS Bedrock

Job description

• Design and implement enterprise data architectures for batch and real-time processing.
• Build AI-ready data pipelines, RAG infrastructure, and vector search using Generative AI technologies.
• Leverage Treasure Data CDP, Kafka, Snowflake/Databricks, and cloud platforms to deliver production-grade solutions.

Required Experience:

• 10+ years in data engineering/architecture with strong ETL/ELT, Python, and SQL.
• Hands-on Treasure Data / CDP and enterprise data warehouse/lakehouse experience.
• Real-time analytics, event-driven architecture, streaming pipelines, and Apache Kafka.

Preferred Qualifications:

• Experience with CDC/Debezium and incremental processing.
• Generative AI data engineering with LangChain, LangGraph, AI Agents, Azure OpenAI, AWS Bedrock.