GenAI Data Engineer: Build AI-Ready Data Pipelines

Wesfarmers Limited; City of Melbourne; On-site; AUD 120,000 - 180,000; Full time

Job summary

Wesfarmers OneDigital seeks an AI Data Engineer in Melbourne to design data components for AI and GenAI solutions, and to build and maintain data pipelines with Snowflake and Microsoft Fabric. You will work with AI Engineers and business teams on RAG, embeddings, vector search, metadata and context design, while ensuring data quality, security and governance across diverse data sources.

The role focuses on enterprise-scale data solutions for Wesfarmers' divisions, embracing AI-enabled data

Qualifications

• 5+ years of enterprise data engineering experience.
• Hands-on with Snowflake and Microsoft Fabric.
• Degree in CS/Data Eng is desirable but not essential.
• Experience with Spark, dbt and APIs.
• Strong SQL and Python skills.
• Knowledge of data governance, security and privacy.

Responsibilities

• Design data components for AI and GenAI solutions.
• Build and maintain data pipelines and integrations.
• Determine data access patterns for enterprise use.
• Create retrieval pipelines for structured and unstructured data.
• Collaborate with AI Engineers on RAG, embeddings, and context design.
• Model data and semantic structures reflecting business meaning.
• Integrate source systems, analytics platforms and APIs.
• Implement data quality, lineage and provenance controls.
• Design secure data-access patterns with permissions in mind.
• Diagnose data quality issues and optimize performance and cost.
• Develop automated testing, deployment and monitoring for data products.
• Work with business SMEs to understand data context.

Skills

Snowflake

Microsoft Fabric

Python

Data pipelines

RAG embeddings

Vector search

Data modelling

SQL

English communication

Education

Bachelor's degree in Computer Science or related field

Tools

dbt

Spark

Git

CI/CD

Job description

Wesfarmers OneDigital seeks an AI Data Engineer in Melbourne to design data components for AI and GenAI solutions, and to build and maintain data pipelines with Snowflake and Microsoft Fabric. You will work with AI Engineers and business teams on RAG, embeddings, vector search, metadata and context design, while ensuring data quality, security and governance across diverse data sources.

The role focuses on enterprise-scale data solutions for Wesfarmers' divisions, embracing AI-enabled data