Databricks Data & AI Architect for IoT & RAG

EPAM Systems; City of Melbourne; On-site; AUD 140,000 - 210,000; Full time

Benefits offered by this job

Great Place To Work 2024 recognition

Global talent collaboration

Online courses and mentoring programs

Job summary

EPAM Systems is seeking a Data and AI Architect in Melbourne to design shared data and AI architecture for Agentic AI solutions on Databricks. You will shape secure ingestion, modeling and governance for IoT and time-series data, enabling RAG retrieval with Delta Lake and Vector Search.

You will collaborate with engineering, product and security teams to drive scalable, reusable designs and manage risk early. The role emphasizes pragmatic systems thinking and architecture decisions across teams.

Qualifications

• Experience designing shared data and AI architecture for production use.
• Translate complex data/AI requirements into architecture decisions.
• Collaborate with engineering, product and security teams to reduce risk.

Responsibilities

• Design shared data and AI architecture on Databricks for Agentic AI solutions.
• Define data modeling standards for IoT and time-series domains.
• Architect ingestion and processing pipelines with Spark and Delta Lake.
• Establish governance, lineage and access controls with Unity Catalog.
• Define secure data access patterns for internal teams and downstream use.
• Design RAG retrieval patterns including vector indexing and datasets.

Skills

Data architecture

IoT data modeling

Time-series analysis

Data governance

Security by design

Tools

Databricks

Delta Lake

Unity Catalog

Apache Spark

Vector Search

Job description

EPAM Systems is seeking a Data and AI Architect in Melbourne to design shared data and AI architecture for Agentic AI solutions on Databricks. You will shape secure ingestion, modeling and governance for IoT and time-series data, enabling RAG retrieval with Delta Lake and Vector Search.

You will collaborate with engineering, product and security teams to drive scalable, reusable designs and manage risk early. The role emphasizes pragmatic systems thinking and architecture decisions across teams.