Databricks Data & AI Architect - IoT & Time-Series Focus

EPAM Systems; Sydney; Vor Ort; AUD 180.000 - 250.000; Vollzeit

Benefits dieser Stelle

Career development

Mentoring programs

Certification support

Global opportunities

Zusammenfassung

EPAM Systems, Inc. in Sydney seeks a Data and AI Architect to design shared data architecture for Agentic AI solutions on Databricks. You will shape secure ingestion, modeling and governance for IoT and time-series data, enabling RAG retrieval patterns with Delta Lake, Unity Catalog and Vector Search.

You will define scalable, reusable foundations and guide cross-functional teams in engineering, product and security to implement architecture decisions with risk management and quality at scale.

Qualifikationen

• Databricks architecture in production environments.
• Data modeling for IoT and time-series data.
• Ingestion pipelines across batch and streaming patterns.

Aufgaben

• Design shared data and AI architecture on Databricks for Agentic AI solutions.
• Define data modeling standards for IoT and time-series domains.
• Ingest and process pipelines using Spark and Delta Lake.
• Establish governance, lineage and access controls with Unity Catalog.
• Define secure data access patterns for internal teams and downstream consumption.
• Design RAG retrieval patterns including indexing for Vector Search.
• Produce architecture decision records and reusable templates.
• Partner with stakeholders to align scope, manage risks and drive implementation quality.

Kenntnisse

Databricks

Delta Lake

Unity Catalog

Spark

Vector Search

RAG retrieval

Data modeling

IoT data

Time-series data

Security governance

Jobbeschreibung

EPAM Systems, Inc. in Sydney seeks a Data and AI Architect to design shared data architecture for Agentic AI solutions on Databricks. You will shape secure ingestion, modeling and governance for IoT and time-series data, enabling RAG retrieval patterns with Delta Lake, Unity Catalog and Vector Search.

You will define scalable, reusable foundations and guide cross-functional teams in engineering, product and security to implement architecture decisions with risk management and quality at scale.