Databricks Data & AI Architect for IoT & RAG

EPAM Systems Inc

Melbourne

On-site

AUD 180,000 - 280,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Great Place To Work 2024
Top 100 Best Places to Work 2023
Mentoring & Certification support

Job summary

EPAM Systems Inc in Melbourne seeks a Data and AI Architect to design a shared data platform on Databricks for IoT and time-series solutions. You will shape secure ingestion, modeling, governance and retrieval patterns to enable scalable AI-ready data products.

You will collaborate with engineering, product and security teams, translate complex requirements into reusable designs, and deliver reference architectures, templates and decision records that guide implementation across multiple teams.

Qualifications

  • Databricks architecture experience in production environments
  • Data modeling expertise including event, time-series, dimensional and canonical modeling patterns
  • Ingestion pipeline experience across batch and streaming patterns
  • IoT and time-series data experience including scale, retention and query optimization
  • Delta Lake expertise including table design, performance tuning and lifecycle management
  • Databricks Unity Catalog experience covering governance, lineage and fine-grained access control
  • Apache Spark expertise for large-scale processing and optimization
  • Data governance and security experience including policy design and secure-by-default architecture
  • Nice to have experience with Vector Search and embedding lifecycles
  • RAG tuning considerations and retrieval quality awareness
  • Experience enabling shared data products across teams

Responsibilities

  • Design shared data and AI architecture on Databricks across Agentic AI solutions
  • Define data modeling standards for IoT and time-series domains aligned to analytics and RAG needs
  • Architect ingestion and processing pipelines using Spark and Delta Lake
  • Establish governance, lineage and access controls with Unity Catalog
  • Define secure data access patterns for internal teams and downstream consumption
  • Design RAG retrieval patterns including indexing strategy and datasets for Vector Search
  • Produce architecture decision records, reference designs and reusable templates
  • Partner with stakeholders to align scope, manage risks and drive implementation quality

Skills

Databricks architecture
Data modeling
Ingestion pipelines
IoT and time-series
Delta Lake
Unity Catalog
Apache Spark
Data governance and security
Vector Search
RAG tuning considerations
Shared data products

Tools

Databricks
Apache Spark
Delta Lake
Unity Catalog
Vector Search

Job description

EPAM Systems Inc in Melbourne seeks a Data and AI Architect to design a shared data platform on Databricks for IoT and time-series solutions. You will shape secure ingestion, modeling, governance and retrieval patterns to enable scalable AI-ready data products.

You will collaborate with engineering, product and security teams, translate complex requirements into reusable designs, and deliver reference architectures, templates and decision records that guide implementation across multiple teams.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Databricks Data & AI Architect for Scalable AI Foundations
Databricks Data & AI Architect for Scalable AI Foundations

EPAM Systems • Australia

On-site
AUD 150,000 - 210,000
Data & AI Solutions Architect
Data & AI Solutions Architect

Neon • Melbourne

On-site
AUD 120,000 - 180,000
Data and AI Architect
Data and AI Architect

EPAM Systems Inc • Melbourne

On-site
AUD 140,000 - 210,000
Great Place To Work 2024 recognition
Global talent collaboration
Online courses and mentoring programs
Data And Ai Architect
Data And Ai Architect

EPAM Systems Inc • Melbourne

On-site
AUD 180,000 - 280,000
Great Place To Work 2024
Top 100 Best Places to Work 2023
Mentoring & Certification support
Databricks Lakehouse Architect for Scalable Data
Databricks Lakehouse Architect for Scalable Data

Pan Asia Group • Melbourne

Hybrid
AUD 180,000 - 280,000
Data & AI Solutions Architect: Drive Customer Impact
Data & AI Solutions Architect: Drive Customer Impact

Neon • Melbourne

On-site
AUD 120,000 - 180,000
Senior Solutions Architect – Enterprise Data & AI Strategy
Senior Solutions Architect – Enterprise Data & AI Strategy

Databricks Inc. • Melbourne

On-site
AUD 180,000 - 280,000
Comprehensive benefits
Principal Architect, Databricks & AI Solutions
Principal Architect, Databricks & AI Solutions

aett • Melbourne

On-site
AUD 180,000 - 260,000
Flexibility
Craft 180 Program
Health & Wellbeing Program
+2
Strategic Data & AI Delivery Architect
Strategic Data & AI Delivery Architect

Databricks Inc. • Melbourne

On-site
AUD 180,000 - 240,000
Databricks Data & AI Architect for IoT & RAG
Databricks Data & AI Architect for IoT & RAG

EPAM Systems Inc • Melbourne

On-site
AUD 140,000 - 210,000
Great Place To Work 2024 recognition
Global talent collaboration
Online courses and mentoring programs
Top locations